diff --git a/CHANGELOG.md b/CHANGELOG.md index ac91dcff05..d759359677 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -4,6 +4,7 @@ All notable changes to **billion-context** are documented here. Versions follow the merge of a `*_release-v*` branch; CI publishes to npm on tag. ## [Unreleased] +- **Image pre-compression (`compress.imageCompression`) and the `image_full` tool removed (#3266).** The opt-in downscale pass and its restore channel are gone from host and kernel: no more arrival-time shrinking, no `image_full` injection, no `[Downscaled screenshots]` notes, no image stats — `sharp` is no longer an optional dependency. Rationale: the restore loop was structurally unreachable on hosts that reject bili-injected tools (codex), and where reachable the model had no reliable way to learn the right ref, producing the 38-round guess-reject-resend loop in #3266 (cache hit 75%→28%). Every image now passes through byte-identical at original resolution. Sessions persisted by older versions load unchanged; their legacy `imageShrinks`/`imageFullRestored` state keys and `imageShrunk*` stats are ignored on load (never materialize). A future redesign is tracked on the issue. - **Incremental marker divert + native client helpers (#3248 phase 2).** A native extension can now send incremental turns on its ORDINARY model requests: stamp `x-bili-plugin-turn: 1` (requires the usual `x-bili-plugin`) and post the incremental payload — the body shape (top-level `conversationId`/`sinceSeq`/`messages`, no top-level `model`) is the final word, so a marker on a non-incremental body rides the normal pipeline unchanged and no provider URL changes. The lane forwards to the ORIGINAL request path; `GET /__bili/plugin/turn` probes capability (`{ok, protocol: 1, feature, enabled, storage}`). Gated by the rollout feature `pluginIncrementalTurns` — default 0% keeps every install byte-identical; force with `rollout.features.pluginIncrementalTurns: true` or `BILI_ROLLOUT_PLUGIN_INCREMENTAL_TURNS=1` (still requires a live unified sidecar). Seeds imply `resync: true` (a first incremental turn never 409s, and interop full-resend traffic is replaced client-authoritatively); a system-only change rides an empty delta. Reference wirings: pi (`before_provider_headers`/`before_provider_request`/`after_provider_response`) and dsh-native (fetch patch `beforeSend`/`headersFor`/`onResponse`), both on the shared state machine in `src/agent/incremental-client.ts` (probe TTL cache, prefix-hash diffing, sticky system, per-conversation dead flag) — new hosts should reuse it. - **Incremental turns (#3248): `POST /__bili/plugin/turn`.** Native hosts that keep their own full local history can stop resending it: the first turn seeds the canonical (server-side, unified messages table), later turns send only the delta (client-added messages including the previous assistant reply), and the lane assembles the full body and re-enters the proxy pipeline in-process — same session (the client's own conversation id), same fold ledger, same nudges/tools, freely interleaving with full-resend traffic. Strict ack contract (`x-bili-applied-seq`; 409 seq-mismatch/turn-in-flight forces resync), sticky system prompt, anthropic request params via allowlist, loopback-gated like every `/__bili/` surface. Requires `storage.unified` (503 otherwise); v1 keeps the O(full) pipeline walk (zero-hit, cheap) — the server-authored prefix fast path is tracked on the issue. A divergent `resync: true` records a base-seq epoch (`session_ext` `inc:base-seq`), so cold rebuilds slice past the rejected branch's append-only rows — one resync heals, restarts included; legacy-only storage degrades to the previous full-union read. - **Resident metadata folds after save (#3050 R3 ②c):** an idle session's metadata record (fold anchors, cache ledger, lineage — the reconciliation bookkeeping that dominates long sessions) swaps to a transparent lazy proxy after the save captures it; any access re-materializes the persisted shape (exactly what a restart restores) with one disk read, and \`/__bili/memory\` gains a \`metadata\` column. Measured ~19.6 MB off the fattest dogfood session; an unrecoverable drop throws instead of persisting a thinned record. diff --git a/CONFIGURATION.md b/CONFIGURATION.md index 3d9d293b75..dabb5532a9 100644 --- a/CONFIGURATION.md +++ b/CONFIGURATION.md @@ -246,7 +246,6 @@ This index is generated from `website/config-reference/*.yaml` — edit the seed | `compress.ccr` | object | enabled in proxy mode since v2 | — | Content cache & retrieve: large outputs stored losslessly beside the session, replaced by head excerpt + pointer fetched back via acp_retrieve; no cap or eviction. | | `compress.search` | object | off | — | Search-behavior settings for search_context; currently holds planAware re-ranking. | | `compress.search.planAware` | boolean | false | — | When on, search_context candidates are re-ranked against current plan state; off keeps byte-identical lexical results. | -| `compress.imageCompression` | object | opt-in (disabled) | — | Opt-in lossy downscale via optional sharp before sending; image_full restores originals; proxy mode only. | | `compress.prompts` | Partial | unset (kernel doctrine) | — | Override the kernel doctrine texts; load-bearing for quality — gated behind acknowledgePromptsRisk. | | `compress.reasoningGuard` | object | off | — | Auto-repair of reasoning-lattice truncation on gpt-5.x/6.x (up to 3 continue-nudge rounds). | | `compress.outputSteering` | object { enabled?, verbosityLevel?, effortRouting? } | enabled false · verbosityLevel 2 | — | Appends a conciseness directive to the system-prompt tail; clamps mechanical continuation requests. | @@ -262,11 +261,6 @@ This index is generated from `website/config-reference/*.yaml` — edit the seed | `compress.ccr.excludeTools` | string[] | [] | — | Tool names excluded from CCR storage. | | `compress.ccr.toolName` | string | "acp_retrieve" | — | Registered name of the retrieval tool. | | `compress.ccr.maxHeadChars` | number | 96 | — | Maximum head-excerpt length left inline at the storage pointer. | -| `compress.imageCompression.enabled` | boolean | false | — | Enable lossy image downscaling (requires the optional sharp dependency). | -| `compress.imageCompression.minTokens` | number | 512 | — | Only downscale images whose counted tokens exceed this. | -| `compress.imageCompression.maxDimension` | number | 1280 | — | Largest output dimension after downscaling. | -| `compress.imageCompression.quality` | number | 80 | — | Encoder quality (1–100). | -| `compress.imageCompression.format` | string | "webp" | — | Output image format. | | `compress.prompts.compressPhilosophy` | string | unset (kernel text) | — | Override of the compression philosophy doctrine paragraph. | | `compress.prompts.howToCompressRules` | string | unset (kernel text) | — | Override of the compression how-to rules. | | `compress.prompts.tier2DistillRules` | string | unset (kernel text) | — | Override of the tier-2 distillation rules. | @@ -1373,19 +1367,6 @@ For each request, the proxy resolves the settings by longest-URL-prefix match (t - **Description:** Opt-in **planning-aware retrieval** for `search_context` (issue #1336). When enabled, if a query matches more blocks than `limit`, the candidates are re-ranked against the current plan state extracted from the in-context message view: the LAST tool call of each planning tool (built-in patterns `TodoWrite`, `todowrite`, `todo_list`, `update_plan`, `TaskCreate`, `TaskUpdate`, plus every `compress.protectedLatestTools` pattern — same latest-wins semantics as the kernel's snapshot protection) and the most recent user turn. Candidate topics/summaries are scored by weighted term overlap with that state; blocks scoring above zero sort first, ties keep the original lexical order. Two things happen only then: the returned subset can differ from the pure lexical cut, and a `[plan-aware]` steering section is appended with (a) `top fetch targets:` — the covered ref spans of the top-scoring returned blocks, and (b) a hint for any covered ref already retrieved ≥2 times this session, pointing at a one-shot `decompress({blockId, startId, endId})` range restore instead of repeat `acp_retrieve`. When the flag is off, when no plan state is in context, or when the match pool fits inside `limit`, the output is byte-identical to the pre-feature behavior. Ranking touches candidate order only — no store/fold/injection mechanics change, no new persistence, and foreign-session searches (`conversation_id`) stay read-only lexical. Every re-rank logs an `[acp-search-plan] …` line with the per-block scores. Companion stats: whole-block decompresses count up in `acp_status` under a `RETRIEVAL QUALITY` line (total, plus how many had a cheaper precise path available — i.e. the block carried a ref span and CCR was armed), so the retrieve-vs-decompress trade can be measured before/after enabling. Sub-fields (merged deepest-wins like every other CompressSettings field): - `planAware: boolean` — master switch; anything other than `true` keeps the feature fully off. -#### `imageCompression` - -- **Type:** `object` (`{ enabled?, minTokens?, maxDimension?, quality?, format? }`) -- **Default:** *(disabled — the feature is off unless you set `enabled: true`)* -- **Status:** ACTIVE (v1 — proxy mode) -- **Description:** Opt-in **image pre-compression** for screenshot-heavy tool results (issue #1095, via the `acp-kernel` image-compression API, acp-kernel >= 0.0.84). Multimodal providers bill images by pixel area, so a phone screenshot costs more than a large code block. When enabled, screenshot-like images (deterministic heuristic classifier: portrait aspect ratio in band + minimum short side) in tool results are downscaled **once at arrival** — before they enter the wire — so the model still sees the UI at a fraction of the billed pixels. Non-screenshot images pass through byte-identical. The routing decision (pass vs downsample + recipe) is made by the kernel per image; the host executes the encode with the optional `sharp` dependency (lazy-loaded; missing or failing ⇒ the original passes through, never blocking the main flow). **Lossy by nature** — unlike text CCR, downscaled pixels can't be retrieved; mitigation: the injected `image_full` tool lets the model restore the original resolution for the rest of the session when it can't read details (sticky, idempotent; the restore persists across restarts with the shrink records). No proxy-side original storage is needed: the client's own history still carries the original bytes (it never saw the shrunk form), so a restored ref simply stops being re-routed and the original rides the wire again. Per-image savings log as `[acp-image] …` lines and aggregate into the `[acp-usage]` suffix (`img-saved=Ntok/MKB xK`). Sub-fields (merged deepest-wins like every other CompressSettings field): - - `enabled: boolean` — master switch; anything other than `true` keeps the feature fully off (byte-identical pass-through, no `image_full` tool on the wire). - - `minTokens: number` — only route images whose billing-aware token estimate ≥ this (kernel default `512`). - - `maxDimension: number` — longest side (px) of the downsample recipe (kernel default `1280`). - - `quality: number` — lossy encode quality 1–100 of the recipe (kernel default `80`). - - `format: "webp" | "jpeg" | "png"` — encode format of the recipe (kernel default `"webp"`). - All four wire carriers are rewritten at the forward boundary: Anthropic `image` blocks, OpenAI `image_url` parts (including single-string data-URL messages; remote URLs are never touched), Responses `input_image`, and Google `inlineData`. Determinism contract (same invariant as CCR #1097): the substituted-at-arrival bytes ARE the standing wire content — a guard refuses to re-route any payload that isn't a known original fingerprint for an already-shrunk ref, so processed messages re-entering the pass (fold re-requests) can't double-shrink and bust the prefix cache. Note the kernel's pixel-tile token estimate is coarse and capped (~2k tokens for large screenshots): a shrink may save real wire bytes while saving zero estimated tokens — both numbers appear in the log. Fingerprint bookkeeping is memory-only (not persisted): after a proxy restart, previously shrunk (non-restored) refs pass through at original resolution until the session resets — the double-shrink guard won't re-route payloads it can't verify as known originals, so savings for those refs pause rather than risk a double-shrink (a reset clears the records, so they re-shrink deterministically on the next arrival); previously restored refs stay restored. v1 scope gate: **proxy mode only** (plugin agents would need `image_full` advertised in their plugin manifest first). Requires `acp-kernel` >= 0.0.84 and the optional `sharp` package for actual shrinking (without it every image passes through unchanged). - #### `rules` - **Type:** `boolean` diff --git a/CONFIGURATION.zh-CN.md b/CONFIGURATION.zh-CN.md index 7ab13782e4..5a53ca12a4 100644 --- a/CONFIGURATION.zh-CN.md +++ b/CONFIGURATION.zh-CN.md @@ -246,7 +246,6 @@ | `compress.ccr` | object | enabled in proxy mode since v2 | — | 内容缓存与回取:大输出无损存到会话旁、替换为首段摘录+指针,模型用 acp_retrieve 取回原文;无上限、永不清除。 | | `compress.search` | object | off | — | search_context 的检索行为设置;当前含 planAware 重排。 | | `compress.search.planAware` | boolean | false | — | 开启后 search_context 候选按当前计划状态重排;关闭时结果逐字节不变。 | -| `compress.imageCompression` | object | opt-in (disabled) | — | 可选有损缩放(依赖可选 sharp)后再发送;image_full 取回原图;仅限代理模式。 | | `compress.prompts` | Partial | unset (kernel doctrine) | — | 覆盖内核教条文本;对压缩质量承重要——受 acknowledgePromptsRisk 门控。 | | `compress.reasoningGuard` | object | off | — | gpt-5.x/6.x 推理格截断自动修复(最多 3 轮继续提示)。 | | `compress.outputSteering` | object { enabled?, verbosityLevel?, effortRouting? } | enabled false · verbosityLevel 2 | — | 向系统提示词尾部附加简洁度指令;只收紧机械延续请求。 | @@ -262,11 +261,6 @@ | `compress.ccr.excludeTools` | string[] | [] | — | 排除出 CCR 存储的工具名。 | | `compress.ccr.toolName` | string | "acp_retrieve" | — | 回取工具的注册名。 | | `compress.ccr.maxHeadChars` | number | 96 | — | 存储指针处内联首段摘录的最大长度。 | -| `compress.imageCompression.enabled` | boolean | false | — | 启用有损图片缩放(需要可选依赖 sharp)。 | -| `compress.imageCompression.minTokens` | number | 512 | — | 只对计得 token 超过该值的图片做缩放。 | -| `compress.imageCompression.maxDimension` | number | 1280 | — | 缩放后的最大输出边长。 | -| `compress.imageCompression.quality` | number | 80 | — | 编码质量(1–100)。 | -| `compress.imageCompression.format` | string | "webp" | — | 输出图片格式。 | | `compress.prompts.compressPhilosophy` | string | unset (kernel text) | — | 覆盖压缩哲学教条文段。 | | `compress.prompts.howToCompressRules` | string | unset (kernel text) | — | 覆盖压缩操作规则。 | | `compress.prompts.tier2DistillRules` | string | unset (kernel text) | — | 覆盖二级蒸馏规则。 | @@ -1378,19 +1372,6 @@ ACP 原生 agent(当前为 `pi` 扩展)会在每个进程内向代理上报 - **说明:** 面向 `search_context` 的可选**规划感知检索**(issue #1336)。启用后,当查询命中的块数超过 `limit` 时,候选块会按当前**规划状态**重排:规划状态从上下文内的消息视图提取——每个规划工具的**最后一次** tool-call(内置模式 `TodoWrite`、`todowrite`、`todo_list`、`update_plan`、`TaskCreate`、`TaskUpdate`,外加全部 `compress.protectedLatestTools` 模式——与内核快照保护的 latest-wins 语义相同)以及最近一条用户消息。候选块的 topic/summary 与该状态的词项做加权重叠打分:得分 >0 的块排前,同分保持原词法顺序。仅在此条件下发生两件事:返回子集可能不同于纯词法截断;结果末尾追加 `[plan-aware]` 引导段——(a) `top fetch targets:` 列出得分最高的返回块所覆盖的 ref 区间,(b) 对本会话内已 retrieve ≥2 次的覆盖 ref 给出提示,建议改用一次性 `decompress({blockId, startId, endId})` 区间恢复代替反复 `acp_retrieve`。标志关闭、上下文中无规划状态、或命中池本就在 `limit` 之内时,输出与功能引入前逐字节一致。重排只动候选顺序——不改存储/折叠/注入机制、不新增持久化、跨会话搜索(`conversation_id`)保持只读词法。每次重排记一条 `[acp-search-plan] …` 日志(含逐块得分)。配套统计:整块 decompress 计入 `acp_status` 的 `RETRIEVAL QUALITY` 行(总数 + 其中有多少次存在更便宜的精确路径可用——即该块带 ref 区间且 CCR 已武装),便于启用前后度量 retrieve 与 decompress 的取舍。子字段(按字段最深层级胜出,与其他 CompressSettings 字段一致): - `planAware: boolean` — 总开关;非 `true` 一律保持功能完全关闭。 -#### `imageCompression` - -- **类型:** `object`(`{ enabled?, minTokens?, maxDimension?, quality?, format? }`) -- **默认值:** *(关闭 —— 除非你设置 `enabled: true`,否则功能完全关闭)* -- **状态:** ACTIVE(v1 —— 仅代理模式) -- **说明:** 面向截图密集型工具结果的可选**图像预压缩**(issue #1095,经 `acp-kernel` image-compression API,需 acp-kernel >= 0.0.84)。多模态供应商按像素面积计费,一张手机截图比一大段代码更贵。启用后,工具结果中的截图类图像(确定性启发式分类器:竖屏宽高比落在区间内 + 最短边下限)会在**到达时降采样一次**——进入线上之前——模型仍能看到 UI,但计费像素降到原来的零头。非截图图像逐字节原样透传。路由决策(直过 vs 降采样 + recipe)由内核逐图做出;宿主用可选的 `sharp` 依赖执行编码(懒加载;缺失或失败 ⇒ 原图透传,绝不阻塞主链路)。**天然有损**——与文本 CCR 不同,降采样后的像素无法找回;缓解手段:注入的 `image_full` 工具允许模型在看不清细节时为整个会话恢复原始分辨率(粘性、幂等;恢复状态随 shrink 记录跨重启持久化)。无需代理侧存储原图:客户端自己的历史仍持有原始字节(它从未见过降采样形态),因此已恢复的 ref 只需停止被重新路由,原图即重新回到 wire。逐图节省量以 `[acp-image] …` 日志行输出,并汇总进 `[acp-usage]` 后缀(`img-saved=Ntok/MKB xK`)。子字段(按字段最深层级胜出,与其他 CompressSettings 字段一致): - - `enabled: boolean` — 总开关;非 `true` 一律保持完全关闭(逐字节透传,线上不出现 `image_full` 工具)。 - - `minTokens: number` — 只对计费感知的 token 估算 ≥ 此值的图像做路由(内核默认 `512`)。 - - `maxDimension: number` — 降采样 recipe 的最长边(px,内核默认 `1280`)。 - - `quality: number` — recipe 的有损编码质量 1–100(内核默认 `80`)。 - - `format: "webp" | "jpeg" | "png"` — recipe 的编码格式(内核默认 `"webp"`)。 - 四种 wire 载体都在 forward 边界改写:Anthropic `image` block、OpenAI `image_url` part(含单字符串 data-URL 消息;远程 URL 永不触碰)、Responses `input_image`、Google `inlineData`。确定性契约(与 CCR #1097 同一不变量):到达时被替换的字节就是长期 wire 内容——守卫拒绝把已 shrink ref 的非已知原图指纹载荷再次路由,因此重新进入 pass 的处理后消息(折叠重请求)不会二次降采样击穿 prefix cache。注意内核的 pixel-tile token 估算是粗粒度且有上限的(大截图约 2k token):一次缩放可能省下真实 wire 字节但省不下估算 token——两个数字都会出现在日志里。指纹簿记仅存内存(不持久化):代理重启后,此前已 shrink(未恢复)的 ref 会以原始分辨率透传,直到会话重置——双收缩守卫不会重新路由它无法验证为已知原图的载荷,因此这些 ref 的节省量暂停而非冒险二次降采样(重置会清除记录,下次到达时确定性重新 shrink);此前已恢复的 ref 保持已恢复状态。v1 范围门控:**仅代理模式**(插件 agent 需要先在插件清单中声明 `image_full`)。要求 `acp-kernel` >= 0.0.84 以及可选的 `sharp` 包才能真正缩放(没有它所有图像原样透传)。 - #### `rules` - **类型:** `boolean` diff --git a/kernel/package.json b/kernel/package.json index 4e287cdef4..db30ddde37 100644 --- a/kernel/package.json +++ b/kernel/package.json @@ -1,6 +1,6 @@ { "name": "acp-kernel", - "version": "0.0.125", + "version": "0.0.126", "description": "Framework-agnostic context-compression engine (model-driven, 3-tier LSM). Pure core: no host dependency.", "license": "MIT", "author": "ranxianglei", diff --git a/kernel/src/compress-tools.ts b/kernel/src/compress-tools.ts index 62fd7d677a..0b7d3cc071 100644 --- a/kernel/src/compress-tools.ts +++ b/kernel/src/compress-tools.ts @@ -22,7 +22,6 @@ export const SEARCH_CONTEXT_TOOL_NAME = "search_context"; export const ACP_STATUS_TOOL_NAME = "acp_status"; export const ACP_CACHE_TOOL_NAME = "acp_cache"; export const ABSORB_TOOL_NAME = "absorb"; -export const IMAGE_FULL_TOOL_NAME = "image_full"; /** Text-protocol trigger tags. The model emits these in its text output to * request compression (used when host client tools cannot coexist with a @@ -740,24 +739,6 @@ export const ABSORB_TOOL_GOOGLE = { parameters: ABSORB_PARAMETERS, }; -/** Opt-in image_full tool (restore original-resolution images for a previously - * downscaled message). Inject/register only when - * config.imageCompression.enabled — NOT part of ACP_TOOLS_* arrays. */ -export const IMAGE_FULL_TOOL_DESCRIPTION = - 'Restore original-resolution images for a previously downscaled message. Call when you cannot read details (text, colors, alignment) in a reduced image: pass the message ref ("mNNNNN") from the [Downscaled screenshots] note. Full resolution applies for the rest of this session.'; - -const IMAGE_FULL_PARAMETERS = { - type: "object" as const, - properties: { - ref: { - type: "string", - description: - "mNNNNN ref of the message whose image(s) should be restored to full resolution", - }, - }, - required: ["ref"], -}; - /** Opt-in retrieve tool (lossless content-cached retrieval). Inject/register * only when config.ccr.enabled — NOT part of ACP_TOOLS_* arrays (same * opt-in pattern as absorb). */ @@ -777,28 +758,6 @@ const RETRIEVE_PARAMETERS = { required: ["ref"], }; -export const IMAGE_FULL_TOOL = { - name: IMAGE_FULL_TOOL_NAME, - description: IMAGE_FULL_TOOL_DESCRIPTION, - input_schema: IMAGE_FULL_PARAMETERS, -}; - -export const IMAGE_FULL_TOOL_OPENAI = { - type: "function" as const, - function: { - name: IMAGE_FULL_TOOL_NAME, - description: IMAGE_FULL_TOOL_DESCRIPTION, - parameters: IMAGE_FULL_PARAMETERS, - }, -}; - -export const IMAGE_FULL_TOOL_RESPONSES = { - type: "function" as const, - name: IMAGE_FULL_TOOL_OPENAI.function.name, - description: IMAGE_FULL_TOOL_OPENAI.function.description, - parameters: IMAGE_FULL_TOOL_OPENAI.function.parameters, -}; - export const RETRIEVE_TOOL = { name: RETRIEVE_TOOL_NAME, description: RETRIEVE_TOOL_DESCRIPTION, diff --git a/kernel/src/config.ts b/kernel/src/config.ts index 82d5fd146e..fb3409c30c 100644 --- a/kernel/src/config.ts +++ b/kernel/src/config.ts @@ -47,13 +47,6 @@ export function defaultConfig( enabled: false, minReduction: 0.1, }, - imageCompression: { - enabled: false, - minTokens: 512, - maxDimension: 1280, - quality: 80, - format: "webp", - }, ccr: { enabled: false, toolName: "acp_retrieve", @@ -73,9 +66,6 @@ export function defaultConfig( ? { ...base.absorb, ...overrides.absorb } : base.absorb, crush: overrides.crush ? { ...base.crush, ...overrides.crush } : base.crush, - imageCompression: overrides.imageCompression - ? { ...base.imageCompression, ...overrides.imageCompression } - : base.imageCompression, ccr: overrides.ccr ? { ...base.ccr, ...overrides.ccr } : base.ccr, }; } @@ -206,35 +196,6 @@ export function validateConfig(config: Config): string[] { } } } - if (config.imageCompression) { - const ic = config.imageCompression; - if ( - ic.minTokens !== undefined && - (!Number.isFinite(ic.minTokens) || ic.minTokens < 0) - ) { - errors.push("imageCompression.minTokens must be finite and >= 0"); - } - if ( - ic.maxDimension !== undefined && - (!Number.isInteger(ic.maxDimension) || ic.maxDimension < 16) - ) { - errors.push("imageCompression.maxDimension must be an integer >= 16"); - } - if ( - ic.quality !== undefined && - (!Number.isFinite(ic.quality) || ic.quality < 1 || ic.quality > 100) - ) { - errors.push("imageCompression.quality must be in [1, 100]"); - } - if ( - ic.format !== undefined && - ic.format !== "webp" && - ic.format !== "jpeg" && - ic.format !== "png" - ) { - errors.push('imageCompression.format must be "webp", "jpeg", or "png"'); - } - } if (config.ccr) { if (config.ccr.enabled && !config.ccr.toolName) { errors.push("ccr.toolName must be a non-empty string when enabled"); diff --git a/kernel/src/image-compress.ts b/kernel/src/image-compress.ts deleted file mode 100644 index a49f2f9ae1..0000000000 --- a/kernel/src/image-compress.ts +++ /dev/null @@ -1,583 +0,0 @@ -import { rawForRef } from "./refs.js"; -import { IMAGE_FULL_TOOL_NAME } from "./compress-tools.js"; -import type { - Config, - CompressionState, - ImageBillingMode, - ImageCompressionConfig, - ImageFormat, - ImageShrinkRecord, -} from "./types.js"; - -/** - * Image pre-compression (#353, filed from billion-context#1095 analysis): - * screenshot-like tool-result images are downscaled ONCE at arrival before - * entering the wire; non-screenshot originals pass through untouched; the - * lossy step is backstopped by the image_full restore channel. - * - * Kernel scope (pure, zero native deps): routing decision + recipe, billing- - * aware token estimation (canonical copy — moved from billion-context - * src/image-tokens.ts), image_full contract (arg parsing, sticky-restore - * state machine, result strings, system-note fragment), shrink records and - * stats counters on session state. - * - * Host scope (NOT here): executing the recipe with a real encoder - * (deterministic resize fit-inside withoutEnlargement → flatten → - * webp{quality} / jpeg{quality, mozjpeg} / png{compressionLevel:9}, keeping - * the smaller of original vs encoded), sidecar file I/O under the #1097 - * store, wire-body substitution across protocols, plugin-manifest - * registration, logging. - * - * Determinism is load-bearing: the downsampled bytes become the standing - * wire content after arrival-time substitution; a non-deterministic recipe - * would invalidate the provider prefix cache mid-session (same invariant as - * #1097's placeholder determinism). - */ - -export const DEFAULT_IMAGE_COMPRESSION_CONFIG: Required = - { - enabled: false, - minTokens: 512, - maxDimension: 1280, - quality: 80, - format: "webp", - }; - -/** Sub-field merge over defaults; hosts layer global → provider → model - * exactly like absorb (three levels). */ -export function resolveImageCompressionConfig( - config: Config, -): Required { - return { - ...DEFAULT_IMAGE_COMPRESSION_CONFIG, - ...(config.imageCompression ?? {}), - }; -} - -// --------------------------------------------------------------------------- -// Billing-aware image token estimation (canonical copy; ported from -// billion-context src/image-tokens.ts — the kernel now owns the math, hosts -// keep only the body-scanning wrapper that feeds ImageMeta in). -// --------------------------------------------------------------------------- - -/** Pixels-mode fallback when dimensions cannot be parsed header-only: the - * worst-case high-detail bill. */ -export const PIXEL_IMAGE_FALLBACK_TOKENS = 16_384; - -const TILE_EDGE = 512; -const TILE_SHORT_SIDE = 768; -const TILE_MAX_EDGE = 2048; - -export interface ImageDimensions { - width: number; - height: number; -} - -// NoUncheckedIndexedAccess: out-of-range reads are impossible after each -// section's length guard, but the type system cannot see that — coalesce. -function byteAt(b: Uint8Array, off: number): number { - return b[off] ?? 0; -} - -function u16be(b: Uint8Array, off: number): number { - return (byteAt(b, off) << 8) | byteAt(b, off + 1); -} - -function u16le(b: Uint8Array, off: number): number { - return byteAt(b, off) | (byteAt(b, off + 1) << 8); -} - -function u32be(b: Uint8Array, off: number): number { - return ( - ((byteAt(b, off) << 24) | - (byteAt(b, off + 1) << 16) | - (byteAt(b, off + 2) << 8) | - byteAt(b, off + 3)) >>> - 0 - ); -} - -function i32le(b: Uint8Array, off: number): number { - return ( - byteAt(b, off) | - (byteAt(b, off + 1) << 8) | - (byteAt(b, off + 2) << 16) | - (byteAt(b, off + 3) << 24) - ); -} - -/** Header-only dimension parse: reads just enough leading bytes for container - * headers. Supports PNG / GIF / BMP / WebP (VP8X, VP8L, VP8 lossy) / JPEG - * (SOF segment scan). Unknown formats or truncated headers → undefined. */ -export function parseImageDimensions( - bytes: Uint8Array, -): ImageDimensions | undefined { - const b = bytes; - if (b.length < 10) return undefined; - // PNG: 8-byte signature, IHDR holds width/height (BE u32) at offset 16. - if (b[0] === 0x89 && b[1] === 0x50 && b[2] === 0x4e && b[3] === 0x47) { - if (b.length < 24) return undefined; - const w = u32be(b, 16); - const h = u32be(b, 20); - return w > 0 && h > 0 ? { width: w, height: h } : undefined; - } - // GIF: "GIF87a"/"GIF89a", logical screen size LE u16 at offsets 6/8. - if (b[0] === 0x47 && b[1] === 0x49 && b[2] === 0x46) { - const w = u16le(b, 6); - const h = u16le(b, 8); - return w > 0 && h > 0 ? { width: w, height: h } : undefined; - } - // BMP: "BM", BITMAPINFOHEADER at 14, width/height signed LE i32 at 18/22 - // (top-down bitmaps carry negative height). - if (b.length >= 26 && b[0] === 0x42 && b[1] === 0x4d) { - const w = i32le(b, 18); - const h = Math.abs(i32le(b, 22)); - return w > 0 && h > 0 ? { width: w, height: h } : undefined; - } - // WebP: RIFF....WEBP + VP8X (extended canvas) / VP8L (lossless) / VP8 (lossy). - // Each chunk carries its own required length (VP8L packs end at byte 24). - if ( - b.length >= 20 && - b[0] === 0x52 && - b[1] === 0x49 && - b[2] === 0x46 && - b[3] === 0x46 && - b[8] === 0x57 && - b[9] === 0x45 && - b[10] === 0x42 && - b[11] === 0x50 - ) { - if (b[12] === 0x56 && b[13] === 0x50 && b[14] === 0x38 && b[15] === 0x58) { - if (b.length < 30) return undefined; - // VP8X: 4-byte flags field, then canvas width-1 / height-1 24-bit LE. - const w = byteAt(b, 24) | (byteAt(b, 25) << 8) | (byteAt(b, 26) << 16); - const h = byteAt(b, 27) | (byteAt(b, 28) << 8) | (byteAt(b, 29) << 16); - return w > 0 && h > 0 ? { width: w + 1, height: h + 1 } : undefined; - } - if (b[12] === 0x56 && b[13] === 0x50 && b[14] === 0x38 && b[15] === 0x4c) { - if (b.length < 25) return undefined; - // VP8L: signature byte 0x2F, then a 4-byte pack: width-1 (14 bits), - // height-1 (14 bits), version (4 bits). - if (b[20] !== 0x2f) return undefined; - const w = (((byteAt(b, 22) & 0x3f) << 8) | byteAt(b, 21)) + 1; - const h = - ((byteAt(b, 24) & 0x0f) << 10) | - (byteAt(b, 23) << 2) | - ((byteAt(b, 22) & 0xc0) >> 6); - return w > 0 && h > 0 ? { width: w, height: h + 1 } : undefined; - } - if (b[12] === 0x56 && b[13] === 0x50 && b[14] === 0x38 && b[15] === 0x20) { - if (b.length < 30) return undefined; - // VP8 lossy: sync code 9D 01 2A, then actual width/height 14-bit fields - // (no -1 encoding, unlike VP8X/VP8L). - if (b[23] !== 0x9d || b[24] !== 0x01 || b[25] !== 0x2a) return undefined; - const w = u16le(b, 26) & 0x3fff; - const h = u16le(b, 28) & 0x3fff; - return w > 0 && h > 0 ? { width: w, height: h } : undefined; - } - return undefined; - } - // JPEG: walk segments until an SOFn marker (C0-CF excluding C4/C8/CC). - if (b[0] === 0xff && b[1] === 0xd8) { - let off = 2; - while (off + 4 <= b.length) { - if (b[off] !== 0xff) { - off += 1; - continue; - } - const marker = byteAt(b, off + 1); - if ( - marker === 0xd8 || - marker === 0x01 || - (marker >= 0xd0 && marker <= 0xd9) - ) { - off += 2; - continue; - } - if (marker === 0xda) break; // SOS with no SOF before it — malformed - const segLen = u16be(b, off + 2); - if (segLen < 2) break; - if ( - marker >= 0xc0 && - marker <= 0xcf && - marker !== 0xc4 && - marker !== 0xc8 && - marker !== 0xcc - ) { - if (off + 9 > b.length) break; - const h = u16be(b, off + 5); - const w = u16be(b, off + 7); - if (w > 0 && h > 0) return { width: w, height: h }; - break; - } - off += 2 + segLen; - } - } - return undefined; -} - -const HEADER_SCAN_CHARS = 64; -const JPEG_SCAN_CHARS = 350_000; - -/** Base64 convenience entry: decodes only the leading slice — enough for - * container headers (PNG/GIF/BMP/WebP within 64 chars; JPEG SOF within ~350K - * chars of EXIF bloat). Node-targeted (Buffer). */ -export function parseImageDimensionsFromBase64( - b64: string, -): ImageDimensions | undefined { - if (typeof b64 !== "string" || b64.length === 0) return undefined; - const head = parseImageDimensions( - Buffer.from(b64.slice(0, HEADER_SCAN_CHARS), "base64"), - ); - if (head) return head; - if (b64.startsWith("/9j/") && b64.length > HEADER_SCAN_CHARS) { - return parseImageDimensions( - Buffer.from(b64.slice(0, JPEG_SCAN_CHARS), "base64"), - ); - } - return undefined; -} - -/** OpenAI high-detail tile model: scale so the short side is at least 768 - * (providers bill small images enlarged), cap the long side at 2048, then - * 85 + 170 per 512×512 tile. Bounds ≈ [765, 2805]. */ -export function pixelTileEstimate(width: number, height: number): number { - if ( - !Number.isFinite(width) || - !Number.isFinite(height) || - width <= 0 || - height <= 0 - ) { - return PIXEL_IMAGE_FALLBACK_TOKENS; - } - let sw = width; - let sh = height; - const shortSide = Math.min(sw, sh); - if (shortSide > 0 && shortSide < TILE_SHORT_SIDE) { - const s = TILE_SHORT_SIDE / shortSide; - sw *= s; - sh *= s; - } - const longSide = Math.max(sw, sh); - if (longSide > TILE_MAX_EDGE) { - const s = TILE_MAX_EDGE / longSide; - sw *= s; - sh *= s; - } - const tiles = Math.ceil(sw / TILE_EDGE) * Math.ceil(sh / TILE_EDGE); - return 85 + 170 * tiles; -} - -/** One image attachment's metadata as seen by the routing decision. */ -export interface ImageMeta { - mediaType: string; - /** Length of the base64 payload (characters). */ - base64Length: number; - width?: number; - height?: number; - /** Upstream billing mode for this image. Default "bytes" (conservative). */ - billing?: ImageBillingMode; - /** Optional base64 payload; only its leading decode budget is read, and - * only when width/height are missing in pixels mode. */ - base64?: string; -} - -/** Billing-aware estimate of an image's token cost. Pixels mode uses the tile - * model on real dimensions (header-parsed from the payload head when absent); - * bytes mode counts ceil(base64len/4). Unknown dims in pixels mode fall back - * to PIXEL_IMAGE_FALLBACK_TOKENS. */ -export function estimateImageTokens(meta: ImageMeta): number { - const billing = meta.billing ?? "bytes"; - if (billing === "bytes") return Math.ceil(meta.base64Length / 4); - const w = meta.width; - const h = meta.height; - if (w && h) return pixelTileEstimate(w, h); - if (meta.base64) { - const dims = parseImageDimensionsFromBase64(meta.base64); - if (dims) return pixelTileEstimate(dims.width, dims.height); - } - return PIXEL_IMAGE_FALLBACK_TOKENS; -} - -// --------------------------------------------------------------------------- -// Routing decision -// --------------------------------------------------------------------------- - -/** Pluggable screenshot classifier. v1 ships the heuristic below; a trained - * router slots in here later without pipeline changes. */ -export interface ScreenshotClassifier { - readonly name: string; - isScreenshotLike(meta: ImageMeta): boolean; -} - -export interface HeuristicClassifierOptions { - /** Low end of the long/short aspect band. Default 1.4. */ - aspectRatioMin?: number; - /** High end of the long/short aspect band. Default 2.6. */ - aspectRatioMax?: number; - /** Short-side floor (px): below it even band-shaped images pass — small - * crops would be upscaled by the tile model and billed larger. Default 720. */ - minShortSide?: number; -} - -/** v1 heuristic: long/short aspect ratio within [1.4, 2.6] AND short side ≥ - * 720 px. Missing dimensions → false (conservative: never route what cannot - * be classified). Known limitation: 3:2 photos (ratio 1.5) false-positive as - * screenshots until a trained router slots into the classifier interface. */ -export function createHeuristicClassifier( - options: HeuristicClassifierOptions = {}, -): ScreenshotClassifier { - const aspectRatioMin = options.aspectRatioMin ?? 1.4; - const aspectRatioMax = options.aspectRatioMax ?? 2.6; - const minShortSide = options.minShortSide ?? 720; - return { - name: "heuristic-v1", - isScreenshotLike(meta) { - const w = meta.width; - const h = meta.height; - if (!w || !h || w <= 0 || h <= 0) return false; - const shortSide = Math.min(w, h); - if (shortSide < minShortSide) return false; - const ratio = Math.max(w, h) / shortSide; - return ratio >= aspectRatioMin && ratio <= aspectRatioMax; - }, - }; -} - -export const DEFAULT_SCREENSHOT_CLASSIFIER: ScreenshotClassifier = - createHeuristicClassifier(); - -export type ImageRouteReason = - | "disabled" - | "not-an-image" - | "below-min-tokens" - | "not-screenshot-like" - | "downsample"; - -/** Downsample parameters the host executes with its own encoder (sharp etc.). */ -export interface DownsampleRecipe { - /** Longest side (px) after resize. */ - maxDimension: number; - quality: number; - format: ImageFormat; -} - -export interface ImageRoutingDecision { - action: "pass" | "downsample"; - reason: ImageRouteReason; - /** Token estimate of the ORIGINAL payload (host log lines). */ - estimatedTokens: number; - recipe?: DownsampleRecipe; -} - -/** Pure + deterministic: same input + config → identical decision, always. - * The host executes the returned recipe exactly once, at arrival time. */ -export function decideImageRoute( - meta: ImageMeta, - config: Config, - classifier: ScreenshotClassifier = DEFAULT_SCREENSHOT_CLASSIFIER, -): ImageRoutingDecision { - const cfg = resolveImageCompressionConfig(config); - const estimatedTokens = estimateImageTokens(meta); - if (!cfg.enabled) - return { action: "pass", reason: "disabled", estimatedTokens }; - if (!meta.mediaType.startsWith("image/")) { - return { action: "pass", reason: "not-an-image", estimatedTokens }; - } - if (estimatedTokens < cfg.minTokens) { - return { action: "pass", reason: "below-min-tokens", estimatedTokens }; - } - if (!classifier.isScreenshotLike(meta)) { - return { action: "pass", reason: "not-screenshot-like", estimatedTokens }; - } - return { - action: "downsample", - reason: "downsample", - estimatedTokens, - recipe: { - maxDimension: cfg.maxDimension, - quality: cfg.quality, - format: cfg.format, - }, - }; -} - -// --------------------------------------------------------------------------- -// image_full restore channel -// --------------------------------------------------------------------------- - -/** Failure-prefix convention (mirrors absorb's marker style): any resultText - * starting with this marks a rejected call. */ -export const IMAGE_FULL_FAILURE_MARKER = "[image_full FAILED:"; - -/** Byte-stable system-prompt fragment; count = images downscaled so far in - * this session. Hosts inject it while the feature is enabled and shrinks - * exist. */ -export function buildImageFullSystemNote(count: number): string { - return `[Downscaled screenshots: ${count} image(s) were reduced before entering context. If you cannot read details (text, colors, alignment) in a reduced image, call ${IMAGE_FULL_TOOL_NAME} with that message's ref ("mNNNNN") to restore the original resolution.]`; -} - -/** Content-store entry-kind contract for image originals (#1097 store layout: - * binary sidecar entries under the same mNNNNN key scheme, append-once, - * drop-on-fold). The kernel owns this shape; file I/O stays host-side. */ -export interface ImageStoreEntry { - kind: "image"; - ref: string; - rawMessageId: string; - mediaType: string; - originalBytes: number; - createdAt: number; -} - -export interface ParsedImageFull { - ref: string; - callId?: string; -} - -/** Lenient arg parser mirroring parseAbsorbInput: accepts object or JSON- - * string payloads, key aliases (ref/messageId/of), trims whitespace. */ -export function parseImageFullInput( - input: unknown, - callId?: string, - onWarn?: (message: string) => void, -): ParsedImageFull | null { - let obj: Record | null = null; - if (typeof input === "string") { - try { - const parsed: unknown = JSON.parse(input); - if (parsed && typeof parsed === "object") - obj = parsed as Record; - } catch { - obj = null; - } - } else if (input && typeof input === "object") { - obj = input as Record; - } - if (!obj) { - onWarn?.( - `[acp-image-full-input] rejected: not an object (${typeof input})`, - ); - return null; - } - let ref: string | undefined; - for (const key of ["ref", "messageId", "of"]) { - const value = obj[key]; - if (typeof value === "string") { - ref = value; - break; - } - } - if (typeof ref !== "string") { - onWarn?.( - `[acp-image-full-input] rejected: need ref (string); keys: ${Object.keys(obj).join(",")}`, - ); - return null; - } - const trimmed = ref.trim(); - if (!trimmed) { - onWarn?.("[acp-image-full-input] rejected: ref is empty"); - return null; - } - return { ref: trimmed, ...(callId ? { callId } : {}) }; -} - -/** Append one shrink record and bump cumulative stats. Pure: returns new state. */ -export function recordImageShrink( - state: CompressionState, - record: ImageShrinkRecord, -): CompressionState { - const bytesSaved = Math.max(0, record.originalBytes - record.shrunkBytes); - const tokensSaved = Math.max(0, record.tokensBefore - record.tokensAfter); - return { - ...state, - imageShrinks: [...(state.imageShrinks ?? []), record], - stats: { - ...state.stats, - imagesShrunk: (state.stats.imagesShrunk ?? 0) + 1, - imageBytesSaved: (state.stats.imageBytesSaved ?? 0) + bytesSaved, - imageTokensSaved: (state.stats.imageTokensSaved ?? 0) + tokensSaved, - }, - }; -} - -export function isImageFullRestored( - state: CompressionState, - ref: string, -): boolean { - return (state.imageFullRestored ?? []).includes(ref); -} - -export function imageShrinksForRef( - state: CompressionState, - ref: string, -): ImageShrinkRecord[] { - return (state.imageShrinks ?? []).filter((r) => r.ref === ref); -} - -export interface ImageFullInput { - ref: string; - state: CompressionState; - config: Config; -} - -export interface ImageFullOutcome { - state: CompressionState; - ok: boolean; - resultText: string; -} - -/** Sticky-restore state machine. Success marks the ref restored for the rest - * of the session (idempotent re-calls report "already restored"). Failure - * modes return ok:false with an [image_full FAILED: ...] resultText. Pure: - * returns new state. */ -export function applyImageFull(input: ImageFullInput): ImageFullOutcome { - const cfg = resolveImageCompressionConfig(input.config); - const ref = input.ref.trim(); - if (!cfg.enabled) { - return { - state: input.state, - ok: false, - resultText: `${IMAGE_FULL_FAILURE_MARKER} image compression is disabled in this session — no image was ever downscaled]`, - }; - } - const rawId = rawForRef(input.state.messageRefs, ref); - if (!rawId) { - return { - state: input.state, - ok: false, - resultText: `${IMAGE_FULL_FAILURE_MARKER} ref ${ref} does not exist in this session]`, - }; - } - if (isImageFullRestored(input.state, ref)) { - return { - state: input.state, - ok: true, - resultText: `already restored (${ref}) — full resolution stays in effect for the rest of this session.`, - }; - } - const shrinks = imageShrinksForRef(input.state, ref); - if (shrinks.length === 0) { - return { - state: input.state, - ok: false, - resultText: `${IMAGE_FULL_FAILURE_MARKER} no downscaled image is recorded for ${ref} — it was passed through untouched or never carried an image]`, - }; - } - return { - state: { - ...input.state, - imageFullRestored: [...(input.state.imageFullRestored ?? []), ref], - }, - ok: true, - resultText: `restored original-resolution image(s) for ${ref} (${shrinks.length} image${shrinks.length === 1 ? "" : "s"}); full resolution applies for the rest of this session.`, - }; -} - -/** Drop ref-keyed image_full state after a compaction reset (native-compaction - * archive, fork recovery, session restart). Refs are re-issued from m00001 - * after a state reset, so stale entries would misattribute. Cumulative stats - * survive — they remain valid aggregates. Hosts MUST call this on every - * state reset. */ -export function resetImageFullState(state: CompressionState): CompressionState { - return { ...state, imageFullRestored: [], imageShrinks: [] }; -} diff --git a/kernel/src/index.ts b/kernel/src/index.ts index 7474e13930..a781234af0 100644 --- a/kernel/src/index.ts +++ b/kernel/src/index.ts @@ -158,10 +158,6 @@ export { ABSORB_TOOL_NAME, ABSORB_TOOL, ABSORB_TOOL_OPENAI, - IMAGE_FULL_TOOL_NAME, - IMAGE_FULL_TOOL, - IMAGE_FULL_TOOL_OPENAI, - IMAGE_FULL_TOOL_RESPONSES, } from "./compress-tools.js"; export { RETRIEVE_TOOL_NAME, @@ -281,39 +277,6 @@ export type { EvaluateCrushInput, ApplyCrushResult, } from "./crush.js"; -export { - DEFAULT_IMAGE_COMPRESSION_CONFIG, - resolveImageCompressionConfig, - PIXEL_IMAGE_FALLBACK_TOKENS, - parseImageDimensions, - parseImageDimensionsFromBase64, - pixelTileEstimate, - estimateImageTokens, - createHeuristicClassifier, - DEFAULT_SCREENSHOT_CLASSIFIER, - decideImageRoute, - buildImageFullSystemNote, - parseImageFullInput, - recordImageShrink, - isImageFullRestored, - imageShrinksForRef, - applyImageFull, - resetImageFullState, - IMAGE_FULL_FAILURE_MARKER, -} from "./image-compress.js"; -export type { - ImageDimensions, - ImageMeta, - ScreenshotClassifier, - HeuristicClassifierOptions, - ImageRouteReason, - DownsampleRecipe, - ImageRoutingDecision, - ParsedImageFull, - ImageStoreEntry, - ImageFullInput, - ImageFullOutcome, -} from "./image-compress.js"; export { rebuildCompressionState } from "./rebuild.js"; export type { RebuildResult, RebuildPorts } from "./rebuild.js"; export { parseCompressArgs } from "./parse-compress-input.js"; diff --git a/kernel/src/persist/state-merge.ts b/kernel/src/persist/state-merge.ts index 456c26b487..5ca3c3ac4e 100644 --- a/kernel/src/persist/state-merge.ts +++ b/kernel/src/persist/state-merge.ts @@ -25,7 +25,5 @@ export function mergeCompressionState( rules: parsed.rules ?? fresh.rules, nextRuleId: parsed.nextRuleId ?? fresh.nextRuleId, terminalStreak: parsed.terminalStreak, - imageFullRestored: parsed.imageFullRestored ?? fresh.imageFullRestored, - imageShrinks: parsed.imageShrinks ?? fresh.imageShrinks, }; } diff --git a/kernel/src/state.ts b/kernel/src/state.ts index 13c9603d48..f745c72665 100644 --- a/kernel/src/state.ts +++ b/kernel/src/state.ts @@ -20,17 +20,12 @@ export function createInitialState(): CompressionState { tokensCompressed: 0, compressionCount: 0, absorbedTokens: 0, - imagesShrunk: 0, - imageBytesSaved: 0, - imageTokensSaved: 0, storedCount: 0, retrievalCount: 0, }, absorbed: [], rules: [], nextRuleId: 1, - imageFullRestored: [], - imageShrinks: [], nextBlockId: 1, nextRunId: 1, }; diff --git a/kernel/src/types.ts b/kernel/src/types.ts index 5b080475e3..00c9479f88 100644 --- a/kernel/src/types.ts +++ b/kernel/src/types.ts @@ -101,12 +101,6 @@ export interface CompressionStats { compressionCount: number; /** Cumulative tokens reclaimed by absorb (instant tool-result hiding). Optional for pre-absorb persisted states. */ absorbedTokens?: number; - /** Cumulative images downscaled at arrival (image pre-compression, #353). Optional for pre-feature persisted states. */ - imagesShrunk?: number; - /** Cumulative decoded-byte savings from image downsampling. */ - imageBytesSaved?: number; - /** Cumulative estimated-token savings from image downsampling. */ - imageTokensSaved?: number; /** Cumulative messages stored in the CCR content store. Optional for pre-CCR persisted states. */ storedCount?: number; /** Cumulative successful acp_retrieve calls. Optional for pre-CCR persisted states. */ @@ -193,41 +187,6 @@ export interface CrushConfig { strategies?: Record; } -export type ImageFormat = "webp" | "jpeg" | "png"; - -/** How upstream bills this image's payload: pixel-tile model (Anthropic / OpenAI high-detail) or raw byte counting (some relays). */ -export type ImageBillingMode = "pixels" | "bytes"; - -/** Image pre-compression routing/downsample + image_full restore (#353). Hosts perform the three-level (global → provider → model) sub-field merge exactly like absorb. Default off: disabled ⇒ byte-identical pass-through. */ -export interface ImageCompressionConfig { - enabled: boolean; - /** Only route images whose token estimate >= this. Default 512. */ - minTokens?: number; - /** Longest side (px) of the downsample recipe. Default 1280. */ - maxDimension?: number; - /** Lossy encode quality (1-100) of the downsample recipe. Default 80. */ - quality?: number; - /** Encode format of the downsample recipe. Default "webp". */ - format?: ImageFormat; -} - -/** One arrival-time image downsample, reported by the host after executing the kernel's recipe. Drives image_full validation and session stats. */ -export interface ImageShrinkRecord { - ref: string; - rawMessageId: string; - mediaType: string; - format: ImageFormat; - /** Decoded byte length of the original payload. */ - originalBytes: number; - /** Decoded byte length after encoding. */ - shrunkBytes: number; - /** Kernel token estimate of the original payload. */ - tokensBefore: number; - /** Kernel token estimate of the shrunk payload. */ - tokensAfter: number; - createdAt: number; -} - export interface CcrConfig { enabled: boolean; /** Model-facing retrieve tool name (adapters may rename, e.g. acp_retrieve). */ @@ -271,10 +230,6 @@ export interface CompressionState { * issued id is never re-issued with different content. Optional: defaults * to 1 when absent on older persisted states. */ nextRuleId?: number; - /** image_full sticky-restore: refs whose images were restored to full resolution for the rest of the session. MUST be cleared on compaction reset (resetImageFullState) — refs are re-issued after state reset, so stale entries would misattribute. Optional: pre-feature persisted states lack it. */ - imageFullRestored?: string[]; - /** Arrival-time downsample records (#353). Optional: pre-feature persisted states lack it. */ - imageShrinks?: ImageShrinkRecord[]; /** Padded refs (mNNNNN) of HIDDEN orphan compress call/result messages — the * orphans beyond the keep-last-N window that hide-consumed removed from the * visible view this turn. Written every processTurn by the hide-compress-calls @@ -459,8 +414,6 @@ export interface Config { rules?: RulesConfig; /** Deterministic tool-result compression, tier 1 of the absorb gate (see crush.ts). Requires absorb enabled. */ crush?: CrushConfig; - /** Image pre-compression routing/downsample + image_full restore (see image-compress.ts). Absent/disabled = feature off. */ - imageCompression?: ImageCompressionConfig; /** Lossless content-cached retrieval for oversized tool results (see ccr.ts). Absent/disabled = feature off. */ ccr?: CcrConfig; messageFilters?: import("./filter/types.js").MessageFiltersConfig; diff --git a/kernel/tests/image-compress.test.ts b/kernel/tests/image-compress.test.ts deleted file mode 100644 index e919b7bd9c..0000000000 --- a/kernel/tests/image-compress.test.ts +++ /dev/null @@ -1,766 +0,0 @@ -import { test } from "node:test"; -import assert from "node:assert/strict"; -import { - DEFAULT_IMAGE_COMPRESSION_CONFIG, - DEFAULT_SCREENSHOT_CLASSIFIER, - IMAGE_FULL_FAILURE_MARKER, - PIXEL_IMAGE_FALLBACK_TOKENS, - applyImageFull, - buildImageFullSystemNote, - createHeuristicClassifier, - decideImageRoute, - estimateImageTokens, - imageShrinksForRef, - isImageFullRestored, - parseImageDimensions, - parseImageDimensionsFromBase64, - parseImageFullInput, - pixelTileEstimate, - recordImageShrink, - resetImageFullState, - resolveImageCompressionConfig, -} from "../src/image-compress.js"; -import type { ImageMeta } from "../src/image-compress.js"; -import { - IMAGE_FULL_TOOL, - IMAGE_FULL_TOOL_NAME, - IMAGE_FULL_TOOL_OPENAI, - IMAGE_FULL_TOOL_RESPONSES, -} from "../src/compress-tools.js"; -import { defaultConfig, validateConfig } from "../src/config.js"; -import { createInitialState } from "../src/state.js"; -import { mergeCompressionState } from "../src/persist/state-merge.js"; -import type { CompressionState, ImageShrinkRecord } from "../src/types.js"; - -function u16beAt(b: Uint8Array, off: number, v: number): void { - b[off] = (v >> 8) & 0xff; - b[off + 1] = v & 0xff; -} - -function u16leAt(b: Uint8Array, off: number, v: number): void { - b[off] = v & 0xff; - b[off + 1] = (v >> 8) & 0xff; -} - -function u32beAt(b: Uint8Array, off: number, v: number): void { - b[off] = (v >>> 24) & 0xff; - b[off + 1] = (v >>> 16) & 0xff; - b[off + 2] = (v >>> 8) & 0xff; - b[off + 3] = v & 0xff; -} - -function u32leAt(b: Uint8Array, off: number, v: number): void { - b[off] = v & 0xff; - b[off + 1] = (v >> 8) & 0xff; - b[off + 2] = (v >> 16) & 0xff; - b[off + 3] = (v >>> 24) & 0xff; -} - -function pngBytes(w: number, h: number): Uint8Array { - const b = new Uint8Array(33); - b.set([0x89, 0x50, 0x4e, 0x47, 0x0d, 0x0a, 0x1a, 0x0a], 0); - u32beAt(b, 8, 13); - b.set([0x49, 0x48, 0x44, 0x52], 12); - u32beAt(b, 16, w); - u32beAt(b, 20, h); - return b; -} - -function gifBytes(w: number, h: number): Uint8Array { - const b = new Uint8Array(13); - b.set([0x47, 0x49, 0x46, 0x38, 0x39, 0x61], 0); - u16leAt(b, 6, w); - u16leAt(b, 8, h); - return b; -} - -function bmpBytes(w: number, h: number): Uint8Array { - const b = new Uint8Array(26); - b.set([0x42, 0x4d], 0); - u32leAt(b, 14, 40); - u32leAt(b, 18, w | 0); - u32leAt(b, 22, h | 0); - return b; -} - -function webpVp8xBytes(w: number, h: number): Uint8Array { - const b = new Uint8Array(30); - b.set([0x52, 0x49, 0x46, 0x46], 0); - u32leAt(b, 4, 22); - b.set([0x57, 0x45, 0x42, 0x50], 8); - b.set([0x56, 0x50, 0x38, 0x58], 12); - u32leAt(b, 16, 10); - b[24] = (w - 1) & 0xff; - b[25] = ((w - 1) >> 8) & 0xff; - b[26] = ((w - 1) >> 16) & 0xff; - b[27] = (h - 1) & 0xff; - b[28] = ((h - 1) >> 8) & 0xff; - b[29] = ((h - 1) >> 16) & 0xff; - return b; -} - -function webpVp8lBytes(w: number, h: number): Uint8Array { - const b = new Uint8Array(25); - b.set([0x52, 0x49, 0x46, 0x46], 0); - u32leAt(b, 4, 22); - b.set([0x57, 0x45, 0x42, 0x50], 8); - b.set([0x56, 0x50, 0x38, 0x4c], 12); - u32leAt(b, 16, 10); - b[20] = 0x2f; - const wm = w - 1; - const hm = h - 1; - b[21] = wm & 0xff; - b[22] = ((wm >> 8) & 0x3f) | ((hm & 0x3) << 6); - b[23] = (hm >> 2) & 0xff; - b[24] = (hm >> 10) & 0x0f; - return b; -} - -function webpVp8LossyBytes(w: number, h: number): Uint8Array { - const b = new Uint8Array(30); - b.set([0x52, 0x49, 0x46, 0x46], 0); - u32leAt(b, 4, 22); - b.set([0x57, 0x45, 0x42, 0x50], 8); - b.set([0x56, 0x50, 0x38, 0x20], 12); - u32leAt(b, 16, 12); - b[23] = 0x9d; - b[24] = 0x01; - b[25] = 0x2a; - b[26] = w & 0xff; - b[27] = (w >> 8) & 0x3f; - b[28] = h & 0xff; - b[29] = (h >> 8) & 0x3f; - return b; -} - -function jpegBytes(w: number, h: number, app1Pad = 0): Uint8Array { - const b = new Uint8Array(14 + app1Pad); - b[0] = 0xff; - b[1] = 0xd8; - let off = 2; - if (app1Pad > 0) { - b[2] = 0xff; - b[3] = 0xe1; - u16beAt(b, 4, app1Pad); - off += 2 + app1Pad; - } - b[off] = 0xff; - b[off + 1] = 0xc0; - u16beAt(b, off + 2, 10); - b[off + 4] = 0x08; - u16beAt(b, off + 5, h); - u16beAt(b, off + 7, w); - b[off + 9] = 0x01; - return b; -} - -const OFF_CFG = () => defaultConfig(200_000); -const ON_CFG = () => - defaultConfig(200_000, { imageCompression: { enabled: true } }); - -const PHONE: ImageMeta = { - mediaType: "image/png", - base64Length: 2_000_000, - width: 1568, - height: 2248, - billing: "pixels", -}; -const DESKTOP: ImageMeta = { - mediaType: "image/jpeg", - base64Length: 1_800_000, - width: 1920, - height: 1080, - billing: "pixels", -}; -const SQUARE_PHOTO: ImageMeta = { - mediaType: "image/jpeg", - base64Length: 3_000_000, - width: 2000, - height: 2000, - billing: "pixels", -}; -const BANNER: ImageMeta = { - mediaType: "image/png", - base64Length: 900_000, - width: 4000, - height: 1000, - billing: "pixels", -}; - -function shrinkRecord( - ref: string, - originalBytes: number, - shrunkBytes: number, - tokensBefore: number, - tokensAfter: number, -): ImageShrinkRecord { - return { - ref, - rawMessageId: `raw-${ref}`, - mediaType: "image/png", - format: "webp", - originalBytes, - shrunkBytes, - tokensBefore, - tokensAfter, - createdAt: 1, - }; -} - -function stateWithRefOnly(): CompressionState { - const state = createInitialState(); - state.messageRefs.byRaw["raw-1"] = "m00001"; - state.messageRefs.byRef["m00001"] = "raw-1"; - return state; -} - -function stateWithShrink(): CompressionState { - const state = stateWithRefOnly(); - return recordImageShrink( - state, - shrinkRecord("m00001", 2_000_000, 180_000, 2125, 765), - ); -} - -test("pixelTileEstimate: known values and bounds", () => { - assert.equal(pixelTileEstimate(1568, 2248), 2125); - assert.equal(pixelTileEstimate(1920, 1080), 2125); - assert.equal(pixelTileEstimate(512, 512), 765); - assert.equal(pixelTileEstimate(100, 100), 765); - assert.equal(pixelTileEstimate(3000, 3000), 2805); - assert.equal(pixelTileEstimate(400, 5000), 765); - assert.equal(pixelTileEstimate(0, 100), PIXEL_IMAGE_FALLBACK_TOKENS); - assert.equal(pixelTileEstimate(Number.NaN, 100), PIXEL_IMAGE_FALLBACK_TOKENS); -}); - -test("estimateImageTokens: bytes mode counts ceil(base64len/4)", () => { - assert.equal( - estimateImageTokens({ mediaType: "image/png", base64Length: 1003 }), - 251, - ); - assert.equal( - estimateImageTokens({ - mediaType: "image/png", - base64Length: 1003, - billing: "bytes", - }), - 251, - ); -}); - -test("estimateImageTokens: pixels mode uses the tile model on known dims", () => { - assert.equal( - estimateImageTokens({ - mediaType: "image/png", - base64Length: 0, - width: 1568, - height: 2248, - billing: "pixels", - }), - 2125, - ); -}); - -test("estimateImageTokens: pixels mode parses dims from the base64 head when absent", () => { - const b64 = Buffer.from(pngBytes(1280, 960)).toString("base64"); - assert.equal( - estimateImageTokens({ - mediaType: "image/png", - base64Length: b64.length, - base64: b64, - billing: "pixels", - }), - pixelTileEstimate(1280, 960), - ); -}); - -test("estimateImageTokens: pixels mode falls back to 16384 for unknown dims", () => { - assert.equal(PIXEL_IMAGE_FALLBACK_TOKENS, 16_384); - assert.equal( - estimateImageTokens({ - mediaType: "image/png", - base64Length: 999_999, - base64: "bm90YW4gaW1hZ2U=", - billing: "pixels", - }), - PIXEL_IMAGE_FALLBACK_TOKENS, - ); -}); - -test("parseImageDimensions: PNG / GIF / BMP / WebP variants", () => { - assert.deepEqual(parseImageDimensions(pngBytes(1280, 960)), { - width: 1280, - height: 960, - }); - assert.deepEqual(parseImageDimensions(gifBytes(320, 200)), { - width: 320, - height: 200, - }); - assert.deepEqual(parseImageDimensions(bmpBytes(1024, 768)), { - width: 1024, - height: 768, - }); - assert.deepEqual(parseImageDimensions(bmpBytes(1024, -768)), { - width: 1024, - height: 768, - }); - assert.deepEqual(parseImageDimensions(webpVp8xBytes(640, 480)), { - width: 640, - height: 480, - }); - assert.deepEqual(parseImageDimensions(webpVp8lBytes(100, 200)), { - width: 100, - height: 200, - }); - assert.deepEqual(parseImageDimensions(webpVp8LossyBytes(800, 600)), { - width: 800, - height: 600, - }); -}); - -test("parseImageDimensions: JPEG SOF scan incl. APP1 skip", () => { - assert.deepEqual(parseImageDimensions(jpegBytes(1280, 960)), { - width: 1280, - height: 960, - }); - assert.deepEqual(parseImageDimensions(jpegBytes(1920, 1080, 60)), { - width: 1920, - height: 1080, - }); -}); - -test("parseImageDimensions: unknown or truncated inputs → undefined", () => { - assert.equal( - parseImageDimensions(new Uint8Array([1, 2, 3, 4, 5, 6, 7, 8, 9, 10])), - undefined, - ); - assert.equal( - parseImageDimensions(new Uint8Array([0x89, 0x50, 0x4e, 0x47])), - undefined, - ); - assert.equal(parseImageDimensions(new Uint8Array([])), undefined); -}); - -test("parseImageDimensionsFromBase64: round-trips headers; JPEG needs the extended scan", () => { - const png = Buffer.from(pngBytes(1568, 2248)).toString("base64"); - assert.deepEqual(parseImageDimensionsFromBase64(png), { - width: 1568, - height: 2248, - }); - const jpeg = Buffer.from(jpegBytes(1920, 1080, 60)).toString("base64"); - assert.deepEqual(parseImageDimensionsFromBase64(jpeg), { - width: 1920, - height: 1080, - }); - assert.equal(parseImageDimensionsFromBase64(""), undefined); - assert.equal(parseImageDimensionsFromBase64("bm90YW4gaW1hZ2U="), undefined); -}); - -test("heuristic classifier: aspect band + short-side floor", () => { - const c = DEFAULT_SCREENSHOT_CLASSIFIER; - assert.equal(c.name, "heuristic-v1"); - assert.equal(c.isScreenshotLike(PHONE), true); - assert.equal(c.isScreenshotLike(DESKTOP), true); - assert.equal(c.isScreenshotLike(SQUARE_PHOTO), false); - assert.equal(c.isScreenshotLike(BANNER), false); - assert.equal( - c.isScreenshotLike({ ...PHONE, width: 640, height: 960 }), - false, - ); - assert.equal( - c.isScreenshotLike({ mediaType: "image/png", base64Length: 1000 }), - false, - ); -}); - -test("heuristic classifier: custom options", () => { - const c = createHeuristicClassifier({ - aspectRatioMin: 2.0, - aspectRatioMax: 3.0, - minShortSide: 100, - }); - assert.equal( - c.isScreenshotLike({ - mediaType: "image/png", - base64Length: 0, - width: 100, - height: 300, - }), - true, - ); - assert.equal( - c.isScreenshotLike({ - mediaType: "image/png", - base64Length: 0, - width: 800, - height: 1200, - }), - false, - ); -}); - -test("decideImageRoute: disabled ⇒ byte-identical pass-through battery", () => { - const metas: ImageMeta[] = [ - PHONE, - DESKTOP, - SQUARE_PHOTO, - BANNER, - { mediaType: "application/pdf", base64Length: 5_000_000 }, - { mediaType: "image/png", base64Length: 100 }, - ]; - for (const meta of metas) { - const d = decideImageRoute(meta, OFF_CFG()); - assert.equal(d.action, "pass"); - assert.equal(d.reason, "disabled"); - assert.equal(d.recipe, undefined); - } -}); - -test("decideImageRoute: screenshot-like ≥ minTokens ⇒ downsample with recipe", () => { - const d = decideImageRoute(PHONE, ON_CFG()); - assert.equal(d.action, "downsample"); - assert.equal(d.reason, "downsample"); - assert.equal(d.estimatedTokens, 2125); - assert.deepEqual(d.recipe, { - maxDimension: 1280, - quality: 80, - format: "webp", - }); -}); - -test("decideImageRoute: below-min-tokens passes untouched", () => { - const meta: ImageMeta = { - mediaType: "image/png", - base64Length: 2000, - width: 1568, - height: 2248, - billing: "bytes", - }; - const d = decideImageRoute(meta, ON_CFG()); - assert.equal(d.action, "pass"); - assert.equal(d.reason, "below-min-tokens"); - assert.equal(d.estimatedTokens, 500); -}); - -test("decideImageRoute: non-screenshot-like and non-image pass untouched", () => { - assert.equal( - decideImageRoute(SQUARE_PHOTO, ON_CFG()).reason, - "not-screenshot-like", - ); - assert.equal( - decideImageRoute(BANNER, ON_CFG()).reason, - "not-screenshot-like", - ); - assert.equal( - decideImageRoute( - { mediaType: "application/pdf", base64Length: 5_000_000 }, - ON_CFG(), - ).reason, - "not-an-image", - ); - assert.equal( - decideImageRoute( - { mediaType: "image/png", base64Length: 1_000_000, billing: "pixels" }, - ON_CFG(), - ).reason, - "not-screenshot-like", - ); -}); - -test("decideImageRoute: custom config values flow into the recipe", () => { - const cfg = defaultConfig(200_000, { - imageCompression: { - enabled: true, - minTokens: 100, - maxDimension: 1000, - quality: 60, - format: "jpeg", - }, - }); - const d = decideImageRoute(PHONE, cfg); - assert.deepEqual(d.recipe, { - maxDimension: 1000, - quality: 60, - format: "jpeg", - }); -}); - -test("decideImageRoute: pluggable classifier injection", () => { - const alwaysTrue = { name: "always", isScreenshotLike: () => true }; - const alwaysFalse = { name: "never", isScreenshotLike: () => false }; - assert.equal( - decideImageRoute(SQUARE_PHOTO, ON_CFG(), alwaysTrue).action, - "downsample", - ); - assert.equal(decideImageRoute(PHONE, ON_CFG(), alwaysFalse).action, "pass"); - assert.equal( - decideImageRoute(PHONE, ON_CFG(), alwaysFalse).reason, - "not-screenshot-like", - ); -}); - -test("decideImageRoute: deterministic across repeated calls", () => { - const metas: ImageMeta[] = [ - PHONE, - DESKTOP, - SQUARE_PHOTO, - BANNER, - { mediaType: "image/png", base64Length: 12_345, billing: "pixels" }, - ]; - for (const meta of metas) { - const first = decideImageRoute(meta, ON_CFG()); - for (let i = 0; i < 50; i++) { - assert.deepEqual(decideImageRoute(meta, ON_CFG()), first); - } - } -}); - -test("recordImageShrink: appends record and bumps cumulative stats", () => { - let state = createInitialState(); - state = recordImageShrink( - state, - shrinkRecord("m00001", 2_000_000, 180_000, 2125, 765), - ); - assert.equal(state.stats.imagesShrunk, 1); - assert.equal(state.stats.imageBytesSaved, 1_820_000); - assert.equal(state.stats.imageTokensSaved, 1360); - assert.equal(state.imageShrinks?.length, 1); - state = recordImageShrink( - state, - shrinkRecord("m00002", 1_000_000, 900_000, 2125, 765), - ); - assert.equal(state.stats.imagesShrunk, 2); - assert.equal(state.stats.imageBytesSaved, 1_920_000); -}); - -test("recordImageShrink: negative deltas clamp to zero; works on pre-feature state shape", () => { - const legacy = createInitialState(); - delete legacy.imageShrinks; - delete legacy.imageFullRestored; - delete legacy.stats.imagesShrunk; - const grown = recordImageShrink( - legacy, - shrinkRecord("m00001", 1000, 1200, 700, 900), - ); - assert.equal(grown.stats.imageBytesSaved, 0); - assert.equal(grown.stats.imageTokensSaved, 0); - assert.equal(grown.imageShrinks?.length, 1); -}); - -test("imageShrinksForRef filters by ref", () => { - let state = stateWithShrink(); - state = recordImageShrink(state, shrinkRecord("m00002", 1000, 500, 100, 50)); - assert.equal(imageShrinksForRef(state, "m00001").length, 1); - assert.equal(imageShrinksForRef(state, "m00002").length, 1); - assert.equal(imageShrinksForRef(state, "m00003").length, 0); -}); - -test("applyImageFull: happy path marks sticky restore", () => { - const state = stateWithShrink(); - const out = applyImageFull({ ref: "m00001", state, config: ON_CFG() }); - assert.equal(out.ok, true); - assert.match( - out.resultText, - /^restored original-resolution image\(s\) for m00001 \(1 image\)/, - ); - assert.deepEqual(out.state.imageFullRestored, ["m00001"]); - assert.equal(isImageFullRestored(out.state, "m00001"), true); -}); - -test("applyImageFull: idempotent second call", () => { - const first = applyImageFull({ - ref: "m00001", - state: stateWithShrink(), - config: ON_CFG(), - }); - const second = applyImageFull({ - ref: "m00001", - state: first.state, - config: ON_CFG(), - }); - assert.equal(second.ok, true); - assert.match(second.resultText, /^already restored \(m00001\)/); - assert.deepEqual(second.state.imageFullRestored, ["m00001"]); -}); - -test("applyImageFull: failure modes use the FAILED marker", () => { - const state = stateWithShrink(); - - const unknown = applyImageFull({ ref: "m00099", state, config: ON_CFG() }); - assert.equal(unknown.ok, false); - assert.ok(unknown.resultText.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.match(unknown.resultText, /ref m00099 does not exist/); - - const noShrink = applyImageFull({ - ref: "m00001", - state: stateWithRefOnly(), - config: ON_CFG(), - }); - assert.equal(noShrink.ok, false); - assert.ok(noShrink.resultText.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.match(noShrink.resultText, /no downscaled image/); - - const disabled = applyImageFull({ ref: "m00001", state, config: OFF_CFG() }); - assert.equal(disabled.ok, false); - assert.ok(disabled.resultText.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.match(disabled.resultText, /image compression is disabled/); - assert.equal(disabled.state, state); -}); - -test("resetImageFullState: clears ref-keyed entries, keeps stats and blocks", () => { - const state = stateWithShrink(); - const restored = applyImageFull({ - ref: "m00001", - state, - config: ON_CFG(), - }).state; - const reset = resetImageFullState(restored); - assert.deepEqual(reset.imageFullRestored, []); - assert.deepEqual(reset.imageShrinks, []); - assert.equal(reset.stats.imagesShrunk, 1); - assert.equal(reset.stats.imageBytesSaved, 1_820_000); - assert.equal(isImageFullRestored(reset, "m00001"), false); -}); - -test("buildImageFullSystemNote: byte-stable, count-aware, mentions the contract", () => { - const a = buildImageFullSystemNote(3); - assert.equal(a, buildImageFullSystemNote(3)); - assert.notEqual(a, buildImageFullSystemNote(4)); - assert.match(a, /\[Downscaled screenshots: 3 image\(s\)/); - assert.match(a, /image_full/); - assert.match(a, /"mNNNNN"/); -}); - -test("parseImageFullInput: object, JSON string, aliases, trim", () => { - assert.deepEqual(parseImageFullInput({ ref: "m00001" }), { ref: "m00001" }); - assert.deepEqual(parseImageFullInput('{"ref":"m00002"}'), { ref: "m00002" }); - assert.deepEqual(parseImageFullInput({ messageId: "m00003" }), { - ref: "m00003", - }); - assert.deepEqual(parseImageFullInput({ of: "m00004" }), { ref: "m00004" }); - assert.deepEqual(parseImageFullInput({ ref: " m00005 " }), { - ref: "m00005", - }); - assert.deepEqual(parseImageFullInput({ ref: "m00001" }, "call-9"), { - ref: "m00001", - callId: "call-9", - }); -}); - -test("parseImageFullInput: rejects malformed payloads with warnings", () => { - const warnings: string[] = []; - const warn = (m: string) => warnings.push(m); - assert.equal(parseImageFullInput(42, undefined, warn), null); - assert.equal(parseImageFullInput(null, undefined, warn), null); - assert.equal(parseImageFullInput("not json", undefined, warn), null); - assert.equal(parseImageFullInput({ summary: "x" }, undefined, warn), null); - assert.equal(parseImageFullInput({ ref: " " }, undefined, warn), null); - assert.equal(warnings.length, 5); - assert.match(warnings[0], /^\[acp-image-full-input\] rejected:/); -}); - -test("image_full tool schemas: three wire shapes, required ref", () => { - assert.equal(IMAGE_FULL_TOOL_NAME, "image_full"); - assert.equal(IMAGE_FULL_TOOL.name, "image_full"); - assert.deepEqual(IMAGE_FULL_TOOL.input_schema.required, ["ref"]); - assert.equal(IMAGE_FULL_TOOL.input_schema.properties.ref.type, "string"); - assert.equal(IMAGE_FULL_TOOL_OPENAI.type, "function"); - assert.equal(IMAGE_FULL_TOOL_OPENAI.function.name, "image_full"); - assert.deepEqual(IMAGE_FULL_TOOL_OPENAI.function.parameters.required, [ - "ref", - ]); - assert.equal(IMAGE_FULL_TOOL_RESPONSES.type, "function"); - assert.deepEqual(IMAGE_FULL_TOOL_RESPONSES.parameters.required, ["ref"]); -}); - -test("defaultConfig: imageCompression defaults are off with issue spec values", () => { - assert.deepEqual(defaultConfig(200_000).imageCompression, { - enabled: false, - minTokens: 512, - maxDimension: 1280, - quality: 80, - format: "webp", - }); - assert.deepEqual( - DEFAULT_IMAGE_COMPRESSION_CONFIG, - defaultConfig(200_000).imageCompression, - ); -}); - -test("defaultConfig: sub-field merge preserves other defaults (absorb-style)", () => { - const cfg = defaultConfig(200_000, { imageCompression: { enabled: true } }); - assert.deepEqual(cfg.imageCompression, { - enabled: true, - minTokens: 512, - maxDimension: 1280, - quality: 80, - format: "webp", - }); - assert.equal(resolveImageCompressionConfig(cfg).enabled, true); -}); - -test("validateConfig: rejects invalid imageCompression fields", () => { - const good = validateConfig( - defaultConfig(200_000, { - imageCompression: { - enabled: true, - minTokens: 0, - maxDimension: 16, - quality: 1, - format: "png", - }, - }), - ); - assert.deepEqual( - good.filter((e) => e.startsWith("imageCompression")), - [], - ); - const bad = validateConfig( - defaultConfig(200_000, { - imageCompression: { - enabled: true, - minTokens: -1, - maxDimension: 8, - quality: 0, - format: "gif", - }, - }), - ); - assert.deepEqual(bad, [ - "imageCompression.minTokens must be finite and >= 0", - "imageCompression.maxDimension must be an integer >= 16", - "imageCompression.quality must be in [1, 100]", - 'imageCompression.format must be "webp", "jpeg", or "png"', - ]); -}); - -test("createInitialState seeds image counters and empty sticky arrays", () => { - const s = createInitialState(); - assert.deepEqual(s.stats, { - tokensCompressed: 0, - compressionCount: 0, - absorbedTokens: 0, - imagesShrunk: 0, - imageBytesSaved: 0, - imageTokensSaved: 0, - storedCount: 0, - retrievalCount: 0, - }); - assert.deepEqual(s.imageFullRestored, []); - assert.deepEqual(s.imageShrinks, []); -}); - -test("mergeCompressionState carries image fields through persist/load", () => { - const state = stateWithShrink(); - const restored = applyImageFull({ - ref: "m00001", - state, - config: ON_CFG(), - }).state; - const merged = mergeCompressionState(restored); - assert.deepEqual(merged.imageFullRestored, ["m00001"]); - assert.equal(merged.imageShrinks?.length, 1); - const freshMerged = mergeCompressionState({ blocks: [] } as CompressionState); - assert.deepEqual(freshMerged.imageFullRestored, []); - assert.deepEqual(freshMerged.imageShrinks, []); -}); diff --git a/kernel/tests/persist.test.ts b/kernel/tests/persist.test.ts index d11ebaa972..75a0d19db3 100644 --- a/kernel/tests/persist.test.ts +++ b/kernel/tests/persist.test.ts @@ -498,9 +498,6 @@ test("mergeCompressionState keeps parsed values over defaults", () => { tokensCompressed: 1234, compressionCount: 7, absorbedTokens: 0, - imagesShrunk: 0, - imageBytesSaved: 0, - imageTokensSaved: 0, storedCount: 0, retrievalCount: 0, }); diff --git a/kernel/tests/wire-schema-top-level.test.ts b/kernel/tests/wire-schema-top-level.test.ts index 6bc1187a4f..dc5e3b076f 100644 --- a/kernel/tests/wire-schema-top-level.test.ts +++ b/kernel/tests/wire-schema-top-level.test.ts @@ -9,9 +9,6 @@ import { ABSORB_TOOL, ABSORB_TOOL_OPENAI, ABSORB_TOOL_GOOGLE, - IMAGE_FULL_TOOL, - IMAGE_FULL_TOOL_OPENAI, - IMAGE_FULL_TOOL_RESPONSES, RETRIEVE_TOOL, RETRIEVE_TOOL_OPENAI, RETRIEVE_TOOL_RESPONSES, @@ -76,17 +73,12 @@ function walk( test("anthropic input_schema: no top-level combinators on any tool", () => { walk(ACP_TOOLS_ANTHROPIC, "anthropic"); assertPlainTopLevel(ABSORB_TOOL as Record, "anthropic"); - assertPlainTopLevel(IMAGE_FULL_TOOL as Record, "anthropic"); assertPlainTopLevel(RETRIEVE_TOOL as Record, "anthropic"); }); test("openai function.parameters: no top-level combinators on any tool", () => { walk(ACP_TOOLS_OPENAI, "openai"); assertPlainTopLevel(ABSORB_TOOL_OPENAI as Record, "openai"); - assertPlainTopLevel( - IMAGE_FULL_TOOL_OPENAI as Record, - "openai", - ); assertPlainTopLevel( RETRIEVE_TOOL_OPENAI as Record, "openai", @@ -96,10 +88,6 @@ test("openai function.parameters: no top-level combinators on any tool", () => { test("responses flat parameters: no top-level combinators on any tool", () => { walk(ACP_TOOLS_RESPONSES, "responses"); walk(ACP_READONLY_TOOLS_RESPONSES, "responses"); - assertPlainTopLevel( - IMAGE_FULL_TOOL_RESPONSES as Record, - "responses", - ); assertPlainTopLevel( RETRIEVE_TOOL_RESPONSES as Record, "responses", diff --git a/package-lock.json b/package-lock.json index 452f9a2adf..903dd1659e 100644 --- a/package-lock.json +++ b/package-lock.json @@ -41,14 +41,11 @@ }, "engines": { "node": ">=20" - }, - "optionalDependencies": { - "sharp": "^0.35.4" } }, "kernel": { "name": "acp-kernel", - "version": "0.0.125", + "version": "0.0.126", "dev": true, "license": "MIT", "devDependencies": { @@ -2064,16 +2061,6 @@ "node": ">=22.19.0" } }, - "node_modules/@emnapi/runtime": { - "version": "1.11.3", - "resolved": "https://registry.npmjs.org/@emnapi/runtime/-/runtime-1.11.3.tgz", - "integrity": "sha512-Xz4Tpyki7XyrpbUK1jR1AhdAdaXyhhY4lZ3neLodmhpuWfy2PAQN5B46sAiU4liOXGLkHypn/qU+jvfWSCYYLA==", - "license": "MIT", - "optional": true, - "dependencies": { - "tslib": "^2.4.0" - } - }, "node_modules/@esbuild/aix-ppc64": { "version": "0.27.7", "resolved": "https://registry.npmjs.org/@esbuild/aix-ppc64/-/aix-ppc64-0.27.7.tgz", @@ -2516,507 +2503,6 @@ "node": ">=18" } }, - "node_modules/@img/colour": { - "version": "1.1.0", - "resolved": "https://registry.npmjs.org/@img/colour/-/colour-1.1.0.tgz", - "integrity": "sha512-Td76q7j57o/tLVdgS746cYARfSyxk8iEfRxewL9h4OMzYhbW4TAcppl0mT4eyqXddh6L/jwoM75mo7ixa/pCeQ==", - "license": "MIT", - "optional": true, - "engines": { - "node": ">=18" - } - }, - "node_modules/@img/sharp-darwin-arm64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-darwin-arm64/-/sharp-darwin-arm64-0.35.4.tgz", - "integrity": "sha512-Uhfl4V4lhP2nbUVF9+hyH1+luj86f1gUFeo8ALYxFoULoU+G87D43BfeMP8XHsk9boxAnCY/bf2EHwhA7MuGsA==", - "cpu": [ - "arm64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "darwin" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-darwin-arm64": "1.3.3" - } - }, - "node_modules/@img/sharp-darwin-x64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-darwin-x64/-/sharp-darwin-x64-0.35.4.tgz", - "integrity": "sha512-hWniXY3bG5qKpkKrAwPe4y+VTPmf086YQAnkxWh7uA1YrlRouWGa0M0Mxj3ZjnXFkv7/TD1bTy9lGUK26vRvWw==", - "cpu": [ - "x64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "darwin" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-darwin-x64": "1.3.3" - } - }, - "node_modules/@img/sharp-freebsd-wasm32": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-freebsd-wasm32/-/sharp-freebsd-wasm32-0.35.4.tgz", - "integrity": "sha512-lIsKw/BU+kjB4eZjxrYrZmwOJYi3Ajrv66iAlBmUPyKc3HpnloevB1g3wxGD9P/5BbQ1brBGl65VRRrCvQDEqA==", - "license": "Apache-2.0", - "optional": true, - "os": [ - "freebsd" - ], - "dependencies": { - "@img/sharp-wasm32": "0.35.4" - }, - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-darwin-arm64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-darwin-arm64/-/sharp-libvips-darwin-arm64-1.3.3.tgz", - "integrity": "sha512-suTBPTDGrI9WodccaDdwZItTSaBYASlBk1NSfElSHrUfzu3szG6lvIF58+WiFvnfzuK8ZBFS5zE00PxqxnRiPg==", - "cpu": [ - "arm64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "darwin" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-darwin-x64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-darwin-x64/-/sharp-libvips-darwin-x64-1.3.3.tgz", - "integrity": "sha512-FVJZ5mITMobmXIz/hPDTw0EintTW5H3WfrxwLqEqjiIihlu+hVRyGrFQ60xl0Lxn7Bt3zdpevPaQi0HEzqz9fw==", - "cpu": [ - "x64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "darwin" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linux-arm": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linux-arm/-/sharp-libvips-linux-arm-1.3.3.tgz", - "integrity": "sha512-3rbU4vqXXc3hY/OiXdl52xZvT0F1yEngWfvqudtPJg/KkyiaQw2DRsFrNzpmLvfavbwOq3qXn36GP8obHRULQA==", - "cpu": [ - "arm" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linux-arm64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linux-arm64/-/sharp-libvips-linux-arm64-1.3.3.tgz", - "integrity": "sha512-0DaL0A6Xu6sQSQFwe4iVCrKWU2cCTItnRsYsCdxAMm9NF6twAA9BKnoqy4hqz4+azQ0JHuA26qiUKsf1XJ/v5A==", - "cpu": [ - "arm64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linux-ppc64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linux-ppc64/-/sharp-libvips-linux-ppc64-1.3.3.tgz", - "integrity": "sha512-cdn1OvUBwsXhbC0zSzJnNzf5MZ/mTrobawDvNXBTxe8VtqKAm0sRuEY2Evzovb/w9JMk4TvRxqt1mekSuJz64w==", - "cpu": [ - "ppc64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linux-riscv64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linux-riscv64/-/sharp-libvips-linux-riscv64-1.3.3.tgz", - "integrity": "sha512-HjPVx7yKz+0lqdhDlTw1tt90wamBoxhiXpvl1XZpJLiHH4RCJ5yDTqH+VlYPv2fwFs89JFw4c1IexYOcQUi4IQ==", - "cpu": [ - "riscv64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linux-s390x": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linux-s390x/-/sharp-libvips-linux-s390x-1.3.3.tgz", - "integrity": "sha512-neWLh+3yCNThxnfy3c4BbVBeGgt9aftno+XbT56iK28RgeDs3UOFWviLWlUu0bArYVYJaFDK+RRohbicUNCm8Q==", - "cpu": [ - "s390x" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linux-x64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linux-x64/-/sharp-libvips-linux-x64-1.3.3.tgz", - "integrity": "sha512-4vKmvAst9nrowcqquKFAyZJUDolUaIp8uRiN0mWFguJ1IplC9/pitXtlnnlU4aa/eJw3J7i67V+pwUL+wZGdsA==", - "cpu": [ - "x64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linuxmusl-arm64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linuxmusl-arm64/-/sharp-libvips-linuxmusl-arm64-1.3.3.tgz", - "integrity": "sha512-Y9kQaLMuNoB0bPYOOdcZMaseNrFpPodIWWMrx+CZyydf2xn68j9WYc6sWWRrDwNkzCQjKYfc68L7jKjGlHMibw==", - "cpu": [ - "arm64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-libvips-linuxmusl-x64": { - "version": "1.3.3", - "resolved": "https://registry.npmjs.org/@img/sharp-libvips-linuxmusl-x64/-/sharp-libvips-linuxmusl-x64-1.3.3.tgz", - "integrity": "sha512-fj8Mv0HHfD1Rr+4I68+3agJynxDWtBFgicTbSOb9Bke6pIwzGcJ+RX/yHjmiEGFMCavY/dxvem7MyNaJF+wDiw==", - "cpu": [ - "x64" - ], - "license": "LGPL-3.0-or-later", - "optional": true, - "os": [ - "linux" - ], - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-linux-arm": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linux-arm/-/sharp-linux-arm-0.35.4.tgz", - "integrity": "sha512-7OAS8gI0EReKGVN2HssHlM6umJgxF5VI3xN0p9FA91p/YO+ou5hiNghLdZ5BEHztwaaK5+bLKRf8x/o2L2nk9A==", - "cpu": [ - "arm" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linux-arm": "1.3.3" - } - }, - "node_modules/@img/sharp-linux-arm64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linux-arm64/-/sharp-linux-arm64-0.35.4.tgz", - "integrity": "sha512-De4jpEnAU8Hd5oT0j1G3uL4ZvTuipVMn7YC6vPaJhy6/7EwEae0SVAoBrUMYQbkLGDm85taVWwuPc1a44LTzCQ==", - "cpu": [ - "arm64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linux-arm64": "1.3.3" - } - }, - "node_modules/@img/sharp-linux-ppc64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linux-ppc64/-/sharp-linux-ppc64-0.35.4.tgz", - "integrity": "sha512-2oYZJeIl4kCcMGk4ouZVjnkCtFrpQFlNEtJ6GbxzhHQchwH0NH/qEb9ykmOl29dqwMq+JhFdZn+1ak2FKhI9fQ==", - "cpu": [ - "ppc64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linux-ppc64": "1.3.3" - } - }, - "node_modules/@img/sharp-linux-riscv64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linux-riscv64/-/sharp-linux-riscv64-0.35.4.tgz", - "integrity": "sha512-cPbNChoRURAWdebDIHSenxRpgEdy7JkPydSnUxRm9VvKD7m0/xVaR/8Fzlu81pk5nHEvHH87UZUA7cTtwnbJSA==", - "cpu": [ - "riscv64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linux-riscv64": "1.3.3" - } - }, - "node_modules/@img/sharp-linux-s390x": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linux-s390x/-/sharp-linux-s390x-0.35.4.tgz", - "integrity": "sha512-RY0JFY8Fd6RonCBtHz+DvadaPkXDSI1AUn6yWL9TipqkZ1vY8w8evqdgyDFnkm4/K1ve1TvZiaePP5oSd4+WVQ==", - "cpu": [ - "s390x" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linux-s390x": "1.3.3" - } - }, - "node_modules/@img/sharp-linux-x64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linux-x64/-/sharp-linux-x64-0.35.4.tgz", - "integrity": "sha512-9qvvEAuk8k89TfWUoX2htWjbAMX8p+NxCppjpcg5k6xMsjhBQPTsoIh36h9Qde4WRuGpJeYnOjdosDn/cnv+OA==", - "cpu": [ - "x64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linux-x64": "1.3.3" - } - }, - "node_modules/@img/sharp-linuxmusl-arm64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linuxmusl-arm64/-/sharp-linuxmusl-arm64-0.35.4.tgz", - "integrity": "sha512-KB5jxpfWQTr0nc3xdHtWChdbifHrBGsd2SM62Eyxrl8afikm+f5qGBU75SJIZBT/S1MC8XyacdlXBMSWq6OURA==", - "cpu": [ - "arm64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linuxmusl-arm64": "1.3.3" - } - }, - "node_modules/@img/sharp-linuxmusl-x64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-linuxmusl-x64/-/sharp-linuxmusl-x64-0.35.4.tgz", - "integrity": "sha512-f+eZJZIQNEEd26RPSW+76chwOf1XtA2Y/O+5ocVyLliHkeih3e+jhLVBdNTd2rS3IbNXK8+ug93Vf5ZXtF5Lxg==", - "cpu": [ - "x64" - ], - "license": "Apache-2.0", - "optional": true, - "os": [ - "linux" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-libvips-linuxmusl-x64": "1.3.3" - } - }, - "node_modules/@img/sharp-wasm32": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-wasm32/-/sharp-wasm32-0.35.4.tgz", - "integrity": "sha512-zQnl4Kwp7Q6NHsENtU2T/00Zi+w3AQNwz3+UaTyVBy2FpXrzXzGjndpK61onhZjRtRpQXxCTeqw19bVyXOh7jA==", - "license": "Apache-2.0 AND LGPL-3.0-or-later AND MIT", - "optional": true, - "dependencies": { - "@emnapi/runtime": "^1.11.3" - }, - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-webcontainers-wasm32": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-webcontainers-wasm32/-/sharp-webcontainers-wasm32-0.35.4.tgz", - "integrity": "sha512-ESfNkywmCfPNyaZjxooddJQiQ+l/nTpGEOGthxiLnIHXC/CmcBixnfwUleX9mCz9ovrUUvKMap/pm8RYbzfwaA==", - "cpu": [ - "wasm32" - ], - "license": "Apache-2.0", - "optional": true, - "dependencies": { - "@img/sharp-wasm32": "0.35.4" - }, - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-win32-arm64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-win32-arm64/-/sharp-win32-arm64-0.35.4.tgz", - "integrity": "sha512-iNdlBX9gLVvqe2I3uIJSIKTq6wckP/DYxZtcqxm09x5Gi24DnFBmPAWZmr60ZyYMG0xlzo6goG3670ar+RXvRw==", - "cpu": [ - "arm64" - ], - "license": "Apache-2.0 AND LGPL-3.0-or-later", - "optional": true, - "os": [ - "win32" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-win32-ia32": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-win32-ia32/-/sharp-win32-ia32-0.35.4.tgz", - "integrity": "sha512-kqRsbaa5CS6KHlpxnN7WhE6vAAugXyZButpRdvDWetlv6Qv4N9WTcrWzF7tXfB9T7MsoadqdI8hmwLq6UlLvtw==", - "cpu": [ - "ia32" - ], - "license": "Apache-2.0 AND LGPL-3.0-or-later", - "optional": true, - "os": [ - "win32" - ], - "engines": { - "node": "^20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - } - }, - "node_modules/@img/sharp-win32-x64": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/@img/sharp-win32-x64/-/sharp-win32-x64-0.35.4.tgz", - "integrity": "sha512-XtmnYhBcrORsJ4XJngyzr/EWP0hRZLAZRFaApdKuviyqF78+ylxh2y06ZmtULAMOnObJ3ucpN0AcwSWnMowTRg==", - "cpu": [ - "x64" - ], - "license": "Apache-2.0 AND LGPL-3.0-or-later", - "optional": true, - "os": [ - "win32" - ], - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - } - }, "node_modules/@isaacs/fs-minipass": { "version": "4.0.1", "resolved": "https://registry.npmjs.org/@isaacs/fs-minipass/-/fs-minipass-4.0.1.tgz", @@ -4795,16 +4281,6 @@ "npm": "1.2.8000 || >= 1.4.16" } }, - "node_modules/detect-libc": { - "version": "2.1.2", - "resolved": "https://registry.npmjs.org/detect-libc/-/detect-libc-2.1.2.tgz", - "integrity": "sha512-Btj2BOOO83o3WyH59e8MgXsxEQVcarkUOpEYrubB0urwnN10yQ364rsiByU11nZlqWYZm05i/of7io4mzihBtQ==", - "license": "Apache-2.0", - "optional": true, - "engines": { - "node": ">=8" - } - }, "node_modules/dir-glob": { "version": "3.0.1", "resolved": "https://registry.npmjs.org/dir-glob/-/dir-glob-3.0.1.tgz", @@ -7245,7 +6721,7 @@ "version": "7.8.5", "resolved": "https://registry.npmjs.org/semver/-/semver-7.8.5.tgz", "integrity": "sha512-Y7/KDsb8LjooZpwaqGyulO6DQlksgCncchHGk+sZIY4SBvUocMBEFH5Ur1fI4dV+Jvl0w6cjvucaIi40puRioA==", - "devOptional": true, + "dev": true, "license": "ISC", "bin": { "semver": "bin/semver.js" @@ -7332,56 +6808,6 @@ "dev": true, "license": "ISC" }, - "node_modules/sharp": { - "version": "0.35.4", - "resolved": "https://registry.npmjs.org/sharp/-/sharp-0.35.4.tgz", - "integrity": "sha512-n++8XWcj+jCOr2IOl7h8LbKnGBDY4aPbmprMONBNFdn0ImXqpGVv5zliDs0V9HbmbCQLpbuo2ej9rAoOQTvMDA==", - "license": "Apache-2.0", - "optional": true, - "dependencies": { - "@img/colour": "^1.1.0", - "detect-libc": "^2.1.2", - "semver": "^7.8.5" - }, - "engines": { - "node": ">=20.9.0" - }, - "funding": { - "url": "https://opencollective.com/libvips" - }, - "optionalDependencies": { - "@img/sharp-darwin-arm64": "0.35.4", - "@img/sharp-darwin-x64": "0.35.4", - "@img/sharp-freebsd-wasm32": "0.35.4", - "@img/sharp-libvips-darwin-arm64": "1.3.3", - "@img/sharp-libvips-darwin-x64": "1.3.3", - "@img/sharp-libvips-linux-arm": "1.3.3", - "@img/sharp-libvips-linux-arm64": "1.3.3", - "@img/sharp-libvips-linux-ppc64": "1.3.3", - "@img/sharp-libvips-linux-riscv64": "1.3.3", - "@img/sharp-libvips-linux-s390x": "1.3.3", - "@img/sharp-libvips-linux-x64": "1.3.3", - "@img/sharp-libvips-linuxmusl-arm64": "1.3.3", - "@img/sharp-libvips-linuxmusl-x64": "1.3.3", - "@img/sharp-linux-arm": "0.35.4", - "@img/sharp-linux-arm64": "0.35.4", - "@img/sharp-linux-ppc64": "0.35.4", - "@img/sharp-linux-riscv64": "0.35.4", - "@img/sharp-linux-s390x": "0.35.4", - "@img/sharp-linux-x64": "0.35.4", - "@img/sharp-linuxmusl-arm64": "0.35.4", - "@img/sharp-linuxmusl-x64": "0.35.4", - "@img/sharp-webcontainers-wasm32": "0.35.4", - "@img/sharp-win32-arm64": "0.35.4", - "@img/sharp-win32-ia32": "0.35.4", - "@img/sharp-win32-x64": "0.35.4" - }, - "peerDependenciesMeta": { - "@types/node": { - "optional": true - } - } - }, "node_modules/side-channel": { "version": "1.1.1", "resolved": "https://registry.npmjs.org/side-channel/-/side-channel-1.1.1.tgz", @@ -7831,13 +7257,6 @@ "dev": true, "license": "Apache-2.0" }, - "node_modules/tslib": { - "version": "2.8.1", - "resolved": "https://registry.npmjs.org/tslib/-/tslib-2.8.1.tgz", - "integrity": "sha512-oJFu94HQb+KVduSUQL7wnpmqnfmLsOA/nAh6b6EH0wCEoK0/mPeXU6c3wKDV83MkOuHPRHtSXKKU99IBazS/2w==", - "license": "0BSD", - "optional": true - }, "node_modules/tsup": { "version": "8.5.1", "resolved": "https://registry.npmjs.org/tsup/-/tsup-8.5.1.tgz", diff --git a/package.json b/package.json index ee0afee500..6d22b2f380 100644 --- a/package.json +++ b/package.json @@ -116,8 +116,5 @@ "client": { "platform": "web" } - }, - "optionalDependencies": { - "sharp": "^0.35.4" } } diff --git a/scripts/update-storage-corpus.ts b/scripts/update-storage-corpus.ts index 185cec97aa..678420dc60 100644 --- a/scripts/update-storage-corpus.ts +++ b/scripts/update-storage-corpus.ts @@ -21,7 +21,7 @@ * publicSnapshotStoredRefs union (the full fork contract) * fork-retained — publicSnapshotRetained only: snapshot persisted, store * NOT (the #2675 ② asymmetry, pinned as-is) - * image — base64 image content + image stats/metadata + * image — base64 image content + pre-#3266 legacy image keys on disk (dropped on load) * ccr — content-store.json sibling (CCR originals, #1097) * twinfile — namespaced v2 file + stale flat v1 twin (#2671 ①) * zstd — BILIZSTD1-framed twin of `folded` (identical digest) @@ -102,7 +102,6 @@ function baseSession(id: string, protocol: Session["meta"]["protocol"], e: Engin cacheSamples: 7, lastInputTokens: 45678, contextTokens: 45678, contextTokensSource: "usage", localInputEstimate: 45000, lastUsageGradeTokens: 44000, lastInputTokensOrigin: "http://127.0.0.1:8199", retrieveCalls: 3, retrieveHits: 2, retrieveMisses: 1, retrieveDelivered: 3, - imageShrunkCount: 0, imageBytesSaved: 0, imageTokensSaved: 0, }, metadata: { corpus: id }, state: e.state, @@ -160,11 +159,17 @@ interface CaseResult { description: string; files: string[]; digest: string; not * (#401 one/full collapse, biliVersion stamp, savedAt→lastSeen) is part of * the pinned round-trip contract — the unified store must reproduce this * digest bit-for-bit after migration. */ -async function writeAndPin(name: string, session: Session, meta: { protocol?: string; upstreamOrigin?: string } = {}): Promise { +async function writeAndPin( + name: string, + session: Session, + meta: { protocol?: string; upstreamOrigin?: string } = {}, + mutateFiles?: (caseDir: string, files: string[]) => void, +): Promise { const dirOf = (n: string): string => path.join(CORPUS_ROOT, n); const caseDir = dirOf(name); fs.mkdirSync(caseDir, { recursive: true }); const files = await writeSessionAwaited(caseDir, session); + mutateFiles?.(caseDir, files); const readStore = new SessionStore({ dir: caseDir, debounceMs: 1, enabled: true }); const loaded = readStore.loadSync(session.id, meta); if (!loaded) throw new Error(`${name}: loadSync returned null`); @@ -326,14 +331,32 @@ async function main(): Promise { stats: { requests: 3, tokensSaved: 0, inputTokens: 99000, cachedTokens: 1000, outputTokens: 500, cacheSamples: 3, lastInputTokens: 99000, contextTokens: 99000, contextTokensSource: "estimate", - imageShrunkCount: 1, imageBytesSaved: 4096, imageTokensSaved: 1024, imageFullCalls: 1, imageFullRestores: 1, }, - metadata: { corpus: "corpus-image", imageShrinks: [{ ref: refFor(e, "rawimg1")!, from: 8192, to: 4096 }] }, + metadata: { corpus: "corpus-image" }, + }); + // Back-compat pin (#3266 removal): the on-disk bytes deliberately keep + // the pre-removal image-compression keys that older versions persisted. + // loadSync drops the stats.* and state.* ones (whitelisted readers) but + // passes metadata through opaquely — metadata.imageShrinks survives as + // inert data in the host bag. The digest covers the LOADED view, so it + // pins exactly that split. + const res = await writeAndPin("image", session, { protocol: "anthropic", upstreamOrigin: "http://127.0.0.1:8199" }, (caseDir, files) => { + const recFile = path.join(caseDir, files.find((f) => f.endsWith(".json"))!); + const rec = JSON.parse(fs.readFileSync(recFile, "utf8")) as { + payload: { stats: Record; metadata: Record; state: Record }; + }; + Object.assign(rec.payload.stats, { + imageShrunkCount: 1, imageBytesSaved: 4096, imageTokensSaved: 1024, + imageFullCalls: 1, imageFullRestores: 1, + }); + rec.payload.metadata.imageShrinks = [{ ref: refFor(e, "rawimg1")!, from: 8192, to: 4096 }]; + rec.payload.state.imageFullRestored = []; + rec.payload.state.imageShrinks = []; + fs.writeFileSync(recFile, JSON.stringify(rec)); }); - const res = await writeAndPin("image", session, { protocol: "anthropic", upstreamOrigin: "http://127.0.0.1:8199" }); manifest["image"] = { ...res, - description: "base64 image message + image stats + imageShrinks metadata", + description: "base64 image message with pre-#3266 legacy image keys on disk (dropped on load)", }; } diff --git a/src/absorb.ts b/src/absorb.ts index 489acc2a14..e123f2d4bd 100644 --- a/src/absorb.ts +++ b/src/absorb.ts @@ -13,7 +13,6 @@ import { } from "acp-kernel"; import { PROXY_TOOL_NAMES, RULE_TOOL_NAME } from "./compress-tool.js"; import { effectiveRulesEnabled } from "./rules-feature.js"; -import { IMAGE_FULL_TOOL_NAME, imageCompressionEnabled } from "./image-compress.js"; import { ccrEnabled, retrieveToolName } from "./store.js"; import { log as loggerLog } from "./logger.js"; import type { Session } from "./session.js"; @@ -52,7 +51,6 @@ export function isProxyToolFor(name: string, session: Session | undefined, confi const absorb = effectiveAbsorbConfig(session, config); if (absorb?.enabled === true && name === (absorb.toolName ?? ABSORB_TOOL_NAME)) return true; if (ccrEnabled(session) && name === retrieveToolName(session)) return true; - if (imageCompressionEnabled(session) && name === IMAGE_FULL_TOOL_NAME) return true; return effectiveRulesEnabled(session, config) && name === RULE_TOOL_NAME; } diff --git a/src/compress-settings.ts b/src/compress-settings.ts index f2dad4e69e..0a86f5b417 100644 --- a/src/compress-settings.ts +++ b/src/compress-settings.ts @@ -1,4 +1,4 @@ -import { DEFAULT_ABSORB_CONFIG, DEFAULT_CCR_CONFIG, DEFAULT_IMAGE_COMPRESSION_CONFIG, defaultPrompts, resolvePrompts, createPackResolver, defaultPackSources, isValidPackName, type AbsorbConfig, type Config, type CcrConfig, type ImageCompressionConfig, type PackSurface, type Prompts } from "acp-kernel"; +import { DEFAULT_ABSORB_CONFIG, DEFAULT_CCR_CONFIG, defaultPrompts, resolvePrompts, createPackResolver, defaultPackSources, isValidPackName, type AbsorbConfig, type Config, type CcrConfig, type PackSurface, type Prompts } from "acp-kernel"; import * as path from "node:path"; import { findRoute, type CompressSettings, type NamedProviderRecipe, type ProviderRoutes } from "./config.js"; import { configDir } from "./paths.js"; @@ -58,7 +58,6 @@ export function mergeCompress( const absorbLevels = [global?.absorb, provider?.absorb, model?.absorb].filter(Boolean) as NonNullable[]; const ccrLevels = [global?.ccr, provider?.ccr, model?.ccr].filter(Boolean) as NonNullable[]; const searchLevels = [global?.search, provider?.search, model?.search].filter(Boolean) as NonNullable[]; - const imageCompressionLevels = [global?.imageCompression, provider?.imageCompression, model?.imageCompression].filter(Boolean) as NonNullable[]; const reasoningLevels = [global?.reasoning, provider?.reasoning, model?.reasoning].filter(Boolean) as NonNullable[]; const reasoningGuardLevels = [global?.reasoningGuard, provider?.reasoningGuard, model?.reasoningGuard].filter(Boolean) as NonNullable[]; const outputSteeringLevels = [global?.outputSteering, provider?.outputSteering, model?.outputSteering].filter(Boolean) as NonNullable[]; @@ -89,7 +88,6 @@ export function mergeCompress( absorb: absorbLevels.length > 0 ? Object.assign({}, ...absorbLevels) : undefined, ccr: ccrLevels.length > 0 ? Object.assign({}, ...ccrLevels) : undefined, search: searchLevels.length > 0 ? Object.assign({}, ...searchLevels) : undefined, - imageCompression: imageCompressionLevels.length > 0 ? Object.assign({}, ...imageCompressionLevels) : undefined, rules: pick("rules"), visibilityMarkers: pick("visibilityMarkers"), @@ -258,11 +256,7 @@ export function hasCompressSettings(s: CompressSettings): boolean { * been verified locally. Host arming (server.ts) further gates it behind * the retrieve tool channel, so plugin mode / no-channel wires stay * inert regardless. - * - `imageCompression` → `imageCompression` (kernel ImageCompressionConfig, - * acp-kernel >= 0.0.84; #1095 pre-compression of image blocks). Unset - * fields inherit DEFAULT_IMAGE_COMPRESSION_CONFIG. Absent - * `s.imageCompression` leaves `base.imageCompression` untouched — the - * feature stays off unless some level enables it. */ + */ // Config as resolved for the kernel, plus preserveRecentTools — the knob // lands in acp-kernel 0.0.93 (acp-kernel#428) but the resolved object is // built and typed here regardless of the installed kernel's Config so both @@ -327,17 +321,6 @@ export function applyCompressSettings(base: Config, limit: number, s: CompressSe maxHeadChars: s.ccr.maxHeadChars ?? d.maxHeadChars, }; } - let imageCompression: ImageCompressionConfig | undefined; - if (s.imageCompression !== undefined) { - const d = DEFAULT_IMAGE_COMPRESSION_CONFIG; - imageCompression = { - enabled: s.imageCompression.enabled === true, - minTokens: s.imageCompression.minTokens ?? d.minTokens, - maxDimension: s.imageCompression.maxDimension ?? d.maxDimension, - quality: s.imageCompression.quality ?? d.quality, - format: s.imageCompression.format ?? d.format, - }; - } const resolved: ResolvedKernelConfig = { ...base, modelContextLimit: limit, @@ -363,7 +346,6 @@ export function applyCompressSettings(base: Config, limit: number, s: CompressSe externalSummary: s.externalSummary !== undefined ? expandExternalSummaryChainTolerant(s.externalSummary, recipes) : (base as ResolvedKernelConfig).externalSummary, ...(absorb !== undefined ? { absorb } : {}), ...(ccr !== undefined ? { ccr } : {}), - ...(imageCompression !== undefined ? { imageCompression } : {}), ...(s.rules !== undefined ? { rules: { enabled: s.rules === true } } : {}), }; return resolved; diff --git a/src/compress-tool.ts b/src/compress-tool.ts index 4372de5935..0fdfaa44cd 100644 --- a/src/compress-tool.ts +++ b/src/compress-tool.ts @@ -20,10 +20,6 @@ import { DECOMPRESS_TOOL_NAME, DECOMPRESS_TOOL_OPENAI, DECOMPRESS_TOOL_RESPONSES, - IMAGE_FULL_TOOL, - IMAGE_FULL_TOOL_NAME, - IMAGE_FULL_TOOL_OPENAI, - IMAGE_FULL_TOOL_RESPONSES, RETRIEVE_TOOL_NAME, RULE_TOOL_NAME, SEARCH_CONTEXT_TOOL, @@ -312,17 +308,6 @@ export function retrieveToolsFor(name: string) { }; } -// #1095: image_full (restore original-resolution images for a previously -// downscaled message). Kernel-owned tool; the kernel ships anthropic/openai/ -// responses shapes — synthesize the missing Google variant in its flat shape -// so every injection point serves one definition. -export { IMAGE_FULL_TOOL, IMAGE_FULL_TOOL_OPENAI, IMAGE_FULL_TOOL_RESPONSES }; -export const IMAGE_FULL_TOOL_GOOGLE = { - name: IMAGE_FULL_TOOL_OPENAI.function.name, - description: IMAGE_FULL_TOOL_OPENAI.function.description, - parameters: IMAGE_FULL_TOOL_OPENAI.function.parameters, -}; - // #1494: models drift off the advertised {content: [...]} schema when they // retry a single range: `content` becomes the single entry OBJECT instead of a // one-element array (kernel hard-rejects it: kind=content-not-array, diff --git a/src/config.ts b/src/config.ts index 5a4d7c5be3..cb81141836 100644 --- a/src/config.ts +++ b/src/config.ts @@ -455,31 +455,6 @@ export type CompressSettings = { * Absent/false = off (byte-identical output). */ planAware?: boolean; }; - /** [#1095] Image pre-compression (kernel `Config.imageCompression`, - * acp-kernel >= 0.0.84). When `enabled`, screenshot-like images in tool - * results are downscaled ONCE at arrival before entering the wire - * (kernel routing decision + recipe, host executes with optional `sharp`); - * non-screenshot originals pass through byte-identical. Lossy by nature — - * backstopped by the injected `image_full` tool: the model requests the - * original resolution for a ref and it applies for the rest of the - * session (originals cached in memory). Off unless explicitly enabled at - * some level; disabled ⇒ byte-identical pass-through. Merged sub-field-wise - * across the three levels like `absorb`/`ccr`. */ - imageCompression?: { - /** Enable image pre-compression for this scope. Absent/false = off - * (byte-identical pass-through). */ - enabled?: boolean; - /** Only route images whose token estimate >= this (kernel default - * 512). */ - minTokens?: number; - /** Longest side (px) of the downsample recipe (kernel default 1280). */ - maxDimension?: number; - /** Lossy encode quality 1-100 of the downsample recipe (kernel - * default 80). */ - quality?: number; - /** Encode format of the downsample recipe (kernel default "webp"). */ - format?: "webp" | "jpeg" | "png"; - }; /** Persistent rule reminders (kernel `Config.rules`, acp-kernel >= 0.0.70). * When `enabled`, an `acp_rule` tool is injected (or advertised in the * plugin manifest): passing a short `rule` records a principle-level @@ -1969,7 +1944,7 @@ const COMPRESS_SETTING_FIELDS = new Set([ "outputHeadroomMaxPct", "tiers", "protectedLatestTools", "protectedTools", "neverPreserveRecentTools", "preserveRecentTools", "visibilityMarkers", "rules", "injectTool", "injectNudge", - "acknowledgePromptsRisk", "absorb", "ccr", "search", "imageCompression", + "acknowledgePromptsRisk", "absorb", "ccr", "search", "prompts", "promptPack", "reasoningGuard", "outputSteering", "priceProfile", "reconcile", "streamSummary", ]); @@ -2641,30 +2616,6 @@ export function parseCompressSettings(v: unknown): (CompressSettings & { injectT if (ok) out.search = cleaned; } } - if ("imageCompression" in obj && obj.imageCompression !== undefined) { - const c = obj.imageCompression; - if (!c || typeof c !== "object" || Array.isArray(c)) { - ok = false; - } else { - const co = c as Record; - const cleaned: NonNullable = {}; - for (const key of ["enabled", "minTokens", "maxDimension", "quality", "format"] as const) { - if (!(key in co)) continue; - const v = co[key]; - if (key === "enabled") { - if (typeof v !== "boolean") { ok = false; continue; } - cleaned.enabled = v; - } else if (key === "minTokens" || key === "maxDimension" || key === "quality") { - if (typeof v !== "number" || !Number.isFinite(v)) { ok = false; continue; } - cleaned[key] = v; - } else { - if (v !== "webp" && v !== "jpeg" && v !== "png") { ok = false; continue; } - cleaned.format = v; - } - } - if (ok) out.imageCompression = cleaned; - } - } if ("prompts" in obj && obj.prompts !== undefined) { const prompts = obj.prompts; if (!prompts || typeof prompts !== "object" || Array.isArray(prompts)) { diff --git a/src/image-compress.ts b/src/image-compress.ts deleted file mode 100644 index 731d174935..0000000000 --- a/src/image-compress.ts +++ /dev/null @@ -1,523 +0,0 @@ -import { - applyImageFull, - buildImageFullSystemNote, - decideImageRoute, - estimateImageTokens, - IMAGE_FULL_FAILURE_MARKER, - IMAGE_FULL_TOOL_NAME, - imageShrinksForRef, - isImageFullRestored, - parseImageDimensionsFromBase64, - parseImageFullInput, - recordImageShrink, - type Config, - type DownsampleRecipe, - type ImageFormat, -} from "acp-kernel"; -import type { BiliMessage } from "acp-kernel/wire"; -import { createHash } from "node:crypto"; -import type { CompressSettings } from "./config.js"; -import type { ResolvedImageBilling } from "./image-tokens.js"; -import { log as loggerLog } from "./logger.js"; -import type { Session } from "./session.js"; -import { toolFail, toolOk, type ProxyToolResult } from "./proxy-tool-result.js"; - -// Image pre-compression host side (#1095 / acp-kernel#353). The kernel owns -// the pure decisions (routing, recipe, token estimation, image_full state -// machine); this module executes them at the forward boundary: rewrite the -// image bytes riding BiliMessage raw carriers BEFORE the wire rebuild, cache -// originals in memory, and serve the image_full restore channel. -// -// Determinism is load-bearing: the downsampled bytes become the standing wire -// content after arrival-time substitution (same invariant as #1097's CCR -// placeholders) — the encode recipe is fixed (see encodeDownsample) and every -// re-encode of the same input must yield identical bytes or the provider -// prefix cache dies mid-session. - -export type ImageCompressionSettings = NonNullable; - -const EFFECTIVE_IMAGE_COMPRESSION_KEY = "effectiveImageCompression"; - -/** Stamp the last-resolved image-compression policy onto the session - * (per-request; mirrors storeEffectiveCcr). */ -export function storeEffectiveImageCompression(session: Session, imageCompression: ImageCompressionSettings | undefined): void { - session.metadata[EFFECTIVE_IMAGE_COMPRESSION_KEY] = imageCompression ?? null; -} - -/** Read back the policy stamped by {@link storeEffectiveImageCompression}. */ -function effectiveImageCompression(session: Session | undefined): ImageCompressionSettings | undefined { - const meta = session?.metadata[EFFECTIVE_IMAGE_COMPRESSION_KEY]; - if (meta && typeof meta === "object" && typeof (meta as ImageCompressionSettings).enabled === "boolean") { - return meta as ImageCompressionSettings; - } - return undefined; -} - -export function imageCompressionEnabled(session: Session | undefined): boolean { - return effectiveImageCompression(session)?.enabled === true; -} - -const EFFECTIVE_IMAGE_FULL_RESTORE_KEY = "effectiveImageFullRestore"; - -/** #3266: whether the restore CHANNEL (tool declaration + trailing note) may - * be advertised on this wire, independently of the downsample pass itself. - * Stamped per-request by handle() mirroring storeEffectiveImageCompression. */ -export function storeImageFullRestoreArmed(session: Session, armed: boolean): void { - session.metadata[EFFECTIVE_IMAGE_FULL_RESTORE_KEY] = armed; -} - -/** #3266: read back the restore-channel stamp. Defaults to ARMED when absent - * (pre-#3266 builds stamped nothing) so unaudited paths keep the old - * behavior; only handle() explicitly disarms a known-unroutable host. */ -export function imageFullRestoreArmed(session: Session | undefined): boolean { - return session?.metadata[EFFECTIVE_IMAGE_FULL_RESTORE_KEY] !== false; -} - -export { IMAGE_FULL_TOOL_NAME }; - -const FORMAT_MEDIA_TYPE: Record = { - webp: "image/webp", - jpeg: "image/jpeg", - png: "image/png", -}; - -// [#1095] sharp is CJS-typed (`export =`): under ESM resolution the callable -// factory lives on `.default`, both in types and in Node's runtime interop. -type SharpFactory = typeof import("sharp").default; - -let sharpState: { mod?: SharpFactory; failed?: boolean; loading?: Promise } = {}; - -function loadSharp(): Promise { - if (sharpState.mod) return Promise.resolve(sharpState.mod); - if (sharpState.failed) return Promise.resolve(null); - if (!sharpState.loading) { - sharpState.loading = import("sharp").then( - (mod) => { - const sharp = mod.default; - sharpState.mod = sharp; - return sharp; - }, - () => { - sharpState.failed = true; - return null; - }, - ); - } - return sharpState.loading; -} - -let sharpMissingWarned = false; - -function warnSharpMissingOnce(log: LogFn): void { - if (sharpMissingWarned) return; - sharpMissingWarned = true; - log("warn", "[acp-image] optional dependency 'sharp' is unavailable — image compression degrades to pass-through (npm install sharp to enable)"); -} - -type LogFn = (level: "info" | "warn" | "error", msg: string) => void; - -/** Deterministic encode recipe (kernel #353 contract): resize fit-inside - * withoutEnlargement → EXIF-rotate → flatten alpha onto white → format - * encoder. Same input bytes + same sharp version ⇒ same output bytes. */ -async function encodeDownsample(input: Buffer, recipe: DownsampleRecipe): Promise { - const sharp = await loadSharp(); - if (!sharp) return null; - let pipeline = sharp(input) - .rotate() - .resize(recipe.maxDimension, recipe.maxDimension, { fit: "inside", withoutEnlargement: true }) - .flatten({ background: "#ffffff" }); - if (recipe.format === "webp") pipeline = pipeline.webp({ quality: recipe.quality }); - else if (recipe.format === "jpeg") pipeline = pipeline.jpeg({ quality: recipe.quality, mozjpeg: true }); - else pipeline = pipeline.png({ compressionLevel: 9 }); - return pipeline.toBuffer(); -} - -function fingerprint(b64: string): string { - return createHash("sha256").update(b64).digest("hex"); -} - -function splitDataUrl(url: string): { mediaType: string; b64: string } | null { - if (!url.startsWith("data:")) return null; - const comma = url.indexOf(","); - if (comma < 0) return null; - const head = url.slice(5, comma); - if (!head.endsWith(";base64")) return null; - const mediaType = head.slice(0, -7); - if (!mediaType) return null; - return { mediaType, b64: url.slice(comma + 1) }; -} - -interface ImageSlot { - b64: string; - mediaType: string; - replace(b64: string, mediaType: string): void; -} - -function anthropicSlots(m: BiliMessage): ImageSlot[] { - const block = m.rawAnthropicBlock as Record | undefined; - if (!block || typeof block !== "object" || block.type !== "image") return []; - const source = block.source as Record | undefined; - if (!source || source.type !== "base64" || typeof source.data !== "string" || typeof source.media_type !== "string") return []; - return [{ - b64: source.data, - mediaType: source.media_type, - replace(b64: string, mediaType: string): void { - source.data = b64; - source.media_type = mediaType; - }, - }]; -} - -function openaiSlots(m: BiliMessage): ImageSlot[] { - const out: ImageSlot[] = []; - const pushPart = (part: unknown): void => { - const p = part as Record | undefined; - if (!p || typeof p !== "object" || p.type !== "image_url") return; - const imageUrl = p.image_url as Record | undefined; - if (!imageUrl) return; - const url = imageUrl.url; - if (typeof url !== "string") return; - const parsed = splitDataUrl(url); - if (!parsed) return; - out.push({ - b64: parsed.b64, - mediaType: parsed.mediaType, - replace(b64: string, mediaType: string): void { - imageUrl.url = `data:${mediaType};base64,${b64}`; - }, - }); - }; - if (Array.isArray(m.rawOpenaiContentParts)) { - for (const part of m.rawOpenaiContentParts) pushPart(part); - } else if (typeof m.rawOpenaiContent === "string") { - const parsed = splitDataUrl(m.rawOpenaiContent); - if (parsed) { - out.push({ - b64: parsed.b64, - mediaType: parsed.mediaType, - replace(b64: string, mediaType: string): void { - (m as { rawOpenaiContent: unknown }).rawOpenaiContent = `data:${mediaType};base64,${b64}`; - }, - }); - } - } - return out; -} - -function responsesSlots(m: BiliMessage): ImageSlot[] { - const item = m.rawResponsesItem as Record | undefined; - if (!item || typeof item !== "object" || !Array.isArray(item.content)) return []; - const out: ImageSlot[] = []; - for (const part of item.content as unknown[]) { - const p = part as Record | undefined; - if (!p || typeof p !== "object" || p.type !== "input_image") continue; - const url = p.image_url; - if (typeof url !== "string") continue; - const parsed = splitDataUrl(url); - if (!parsed) continue; - out.push({ - b64: parsed.b64, - mediaType: parsed.mediaType, - replace(b64: string, mediaType: string): void { - p.image_url = `data:${mediaType};base64,${b64}`; - }, - }); - } - return out; -} - -function googleSlots(m: BiliMessage): ImageSlot[] { - if (!Array.isArray(m.rawGoogleParts)) return []; - const out: ImageSlot[] = []; - for (const part of m.rawGoogleParts as unknown[]) { - const p = part as Record | undefined; - if (!p || typeof p !== "object") continue; - const inline = p.inlineData as Record | undefined; - if (!inline || typeof inline.data !== "string" || typeof inline.mimeType !== "string") continue; - out.push({ - b64: inline.data, - mediaType: inline.mimeType, - replace(b64: string, mediaType: string): void { - inline.data = b64; - inline.mimeType = mediaType; - }, - }); - } - return out; -} - -/** All image slots carried by one message, deduped by payload fingerprint - * (the mirror fields are bookkeeping, never slots). */ -function imageSlots(m: BiliMessage): ImageSlot[] { - const seen = new Set(); - const out: ImageSlot[] = []; - for (const slot of [...anthropicSlots(m), ...openaiSlots(m), ...responsesSlots(m), ...googleSlots(m)]) { - const fp = fingerprint(slot.b64); - if (seen.has(fp)) continue; - seen.add(fp); - out.push(slot); - } - return out; -} - -/** Keep the mirror bookkeeping fields in sync when the image they describe - * was rewritten (they hold the FIRST image of the message — compare before - * touching so a multi-image message shrunk elsewhere stays untouched). */ -function syncMirrors(m: BiliMessage, oldB64: string, newB64: string, newMediaType: string): void { - if (m.imageBase64 === oldB64) { - m.imageBase64 = newB64; - m.imageMediaType = newMediaType; - } -} - -const MAX_ENCODE_CACHE_ENTRIES = 256; - -function noteFingerprintByRef(session: Session, ref: string, fp: string): void { - if (!session.imageFingerprintsByRef) session.imageFingerprintsByRef = new Map(); - const fps = session.imageFingerprintsByRef.get(ref) ?? []; - if (!fps.includes(fp)) fps.push(fp); - session.imageFingerprintsByRef.set(ref, fps); -} - -function invalidateForRef(session: Session, ref: string): void { - const fps = session.imageFingerprintsByRef?.get(ref); - if (fps && session.imageEncodeCache) { - for (const fp of fps) session.imageEncodeCache.delete(fp); - } - session.imageFingerprintsByRef?.delete(ref); -} - -/** Arrival-time downsample pass over the prepared message list (mutates the - * raw carriers in place — never replaces message refs, so downstream views - * see the rewritten bytes). Skips restored refs (image_full), skips - * unreferenced messages (ephemeral), never throws (per-slot catch → - * pass-through). Idempotent: recorded refs re-encode deterministically via - * the fingerprint cache. */ -export async function applyImageCompressionPass(session: Session, messages: BiliMessage[], opts: { config: Config; billing: ResolvedImageBilling; cap?: number; log?: LogFn }): Promise { - if (!imageCompressionEnabled(session)) return; - const log: LogFn = opts.log ?? ((level, msg) => loggerLog(level, msg)); - // #1843-L3: the saved-token stat must agree with the window accounting — - // an operator-declared imageTokenCap bounds every billed cost, so bound - // the recorded before/after too. The ROUTING decision stays uncapped: the - // cap is a billing ceiling, not a statement about the image's physical - // size, and shrinking bytes is still worth doing. - const capCost = (n: number): number => (opts.cap !== undefined && opts.cap > 0 ? Math.min(n, opts.cap) : n); - let shrunkThisPass = 0; - let bytesSaved = 0; - let tokensSaved = 0; - for (const m of messages) { - if (typeof m.id !== "string") continue; - const ref = session.state.messageRefs.byRaw[m.id]; - if (!ref) continue; - if (isImageFullRestored(session.state, ref)) continue; - const slots = imageSlots(m); - if (slots.length === 0) continue; - // A ref already shrunk earlier may come back carrying OUR emitted - // bytes (e.g. a folded re-request built from processed messages): only - // known-original payloads may be touched, or we double-shrink and the - // standing wire bytes stop being byte-stable (prefix-cache invariant). - // Captured pre-loop so records created mid-loop never block siblings. - const shrinkRecords = imageShrinksForRef(session.state, ref); - const hadRecord = shrinkRecords.length > 0; - const knownOriginalFps = [...(session.imageFingerprintsByRef?.get(ref) ?? [])]; - for (const slot of slots) { - try { - const fp = fingerprint(slot.b64); - // #3266: after a state reload (process restart, LRU evict+reload) - // the persisted records survive but the in-memory fingerprint map - // is gone. Recognize the original by its recorded byte size — the - // keep-smaller rule below makes any shrunk output strictly smaller - // than the original, so an exact size match is unambiguous. Without - // this the slot passes through forever and the full-size original - // bytes ride the wire indefinitely (the feature silently off). - if (hadRecord && !knownOriginalFps.includes(fp) && !shrinkRecords.some((r) => r.originalBytes === Math.ceil(slot.b64.length * 3 / 4))) continue; - const cached = session.imageEncodeCache?.get(fp); - let shrunk: { b64: string; mediaType: string; format: ImageFormat } | null = cached ? { ...cached, format: cachedFormat(cached.mediaType) } : null; - if (!shrunk) { - const dims = parseImageDimensionsFromBase64(slot.b64); - const decision = decideImageRoute( - { mediaType: slot.mediaType, base64Length: slot.b64.length, width: dims?.width, height: dims?.height, billing: opts.billing, base64: slot.b64 }, - opts.config, - ); - if (decision.action !== "downsample" || !decision.recipe) continue; - const origBuf = Buffer.from(slot.b64, "base64"); - const encoded = await encodeDownsample(origBuf, decision.recipe); - if (!encoded) { - warnSharpMissingOnce(log); - continue; - } - // Keep-smaller rule: a lossy encode that does not beat the - // original bytes buys nothing (and changes the pixels) — - // pass through untouched. - if (encoded.length >= origBuf.length) continue; - shrunk = { b64: encoded.toString("base64"), mediaType: FORMAT_MEDIA_TYPE[decision.recipe.format], format: decision.recipe.format }; - if (!session.imageEncodeCache) session.imageEncodeCache = new Map(); - while (session.imageEncodeCache.size >= MAX_ENCODE_CACHE_ENTRIES) { - const oldest = session.imageEncodeCache.keys().next().value as string | undefined; - if (oldest === undefined) break; - session.imageEncodeCache.delete(oldest); - } - session.imageEncodeCache.set(fp, { b64: shrunk.b64, mediaType: shrunk.mediaType }); - } - const origB64 = slot.b64; - const origMediaType = slot.mediaType; - slot.replace(shrunk.b64, shrunk.mediaType); - syncMirrors(m, origB64, shrunk.b64, shrunk.mediaType); - noteFingerprintByRef(session, ref, fp); - if (imageShrinksForRef(session.state, ref).length === 0) { - const dimBefore = parseImageDimensionsFromBase64(origB64); - const dimAfter = parseImageDimensionsFromBase64(shrunk.b64); - const tokensBefore = capCost(estimateImageTokens({ mediaType: origMediaType, base64Length: origB64.length, width: dimBefore?.width, height: dimBefore?.height, billing: opts.billing, base64: origB64 })); - const tokensAfter = capCost(estimateImageTokens({ mediaType: shrunk.mediaType, base64Length: shrunk.b64.length, width: dimAfter?.width, height: dimAfter?.height, billing: opts.billing, base64: shrunk.b64 })); - const originalBytes = Math.ceil(origB64.length * 3 / 4); - const shrunkBytes = Math.ceil(shrunk.b64.length * 3 / 4); - session.state = recordImageShrink(session.state, { - ref, - rawMessageId: m.id, - mediaType: origMediaType, - format: shrunk.format, - originalBytes, - shrunkBytes, - tokensBefore, - tokensAfter, - createdAt: Date.now(), - }); - bytesSaved += originalBytes - shrunkBytes; - tokensSaved += tokensBefore - tokensAfter; - shrunkThisPass += 1; - log("info", `[acp-image] [${session.id}] ${ref}: ${origMediaType} ${originalBytes}B→${shrunkBytes}B (${tokensBefore}→${tokensAfter} tok, saved ${originalBytes - shrunkBytes}B/${tokensBefore - tokensAfter} tok)`); - } - } catch (err) { - log("warn", `[${session.id}] image compression failed for ${ref}: ${String(err)} — passing through`); - } - } - } - if (shrunkThisPass > 0) { - session.stats.imageShrunkCount = (session.stats.imageShrunkCount ?? 0) + shrunkThisPass; - session.stats.imageBytesSaved = (session.stats.imageBytesSaved ?? 0) + bytesSaved; - session.stats.imageTokensSaved = (session.stats.imageTokensSaved ?? 0) + tokensSaved; - } -} - -function cachedFormat(mediaType: string): ImageFormat { - if (mediaType === "image/jpeg") return "jpeg"; - if (mediaType === "image/png") return "png"; - return "webp"; -} - -/** #3266: refs whose shrunken payload is currently restorable — a shrink - * record exists, the ref is not yet restored, and the ref still resolves in - * the live ref map (a pruned ref would be rejected by image_full anyway — - * listing it would feed exactly the guessing loop this exists to kill). - * Sorted by ref number so the note bytes are stable across rounds. */ -export function restorableRefs(session: Session): string[] { - const byRef = session.state.messageRefs.byRef; - const seen = new Set(); - const out: string[] = []; - for (const r of session.state.imageShrinks ?? []) { - if (seen.has(r.ref)) continue; - seen.add(r.ref); - if (isImageFullRestored(session.state, r.ref)) continue; - if (!byRef[r.ref]) continue; - out.push(r.ref); - } - return out.sort((a, b) => Number(a.replace(/\D/g, "")) - Number(b.replace(/\D/g, "")) || a.localeCompare(b)); -} - -const MAX_LISTED_REFS = 20; - -function formatRefList(refs: string[]): string { - const listed = refs.slice(0, MAX_LISTED_REFS); - const extra = refs.length - listed.length; - return `${listed.join(", ")}${extra > 0 ? `, +${extra} more` : ""}`; -} - -/** #3266: consecutive-failure guardrail threshold — at this many failures in - * a row the restore note stops being injected (a model guessing refs burns a - * full re-request per failure; the nudge then amplifies the storm instead of - * fixing it). Any success resets the streak and re-arms the note. */ -const IMAGE_FULL_NOTE_SUPPRESS_STREAK = 2; - -/** #3266: appended to every failed image_full receipt — the model must never - * learn which refs are restorable from guesswork. */ -function restorableRefsSuffix(session: Session): string { - const refs = restorableRefs(session); - return refs.length > 0 - ? `\nRestorable refs in this session (use exactly one as the ref argument): ${formatRefList(refs)}.` - : "\nNo downscaled image in this session is currently restorable."; -} - -function bumpFailStreak(session: Session): void { - const streak = (session.stats.imageFullFailStreak ?? 0) + 1; - session.stats.imageFullFailStreak = streak; - if (streak === IMAGE_FULL_NOTE_SUPPRESS_STREAK) { - loggerLog("warn", `[acp-image] [${session.id}] ${streak} consecutive image_full failures — restore note suppressed until a successful restore`); - } -} - -/** Execute one image_full call (sticky restore for the rest of the session). - * Mirrors executeRetrieve's shape; the restore itself is passive — the next - * forward pass emits the cached/original bytes for the ref. */ -export function executeImageFull(args: Record, session: Session, config: Config, callId?: string): ProxyToolResult { - session.stats.imageFullCalls = (session.stats.imageFullCalls ?? 0) + 1; - const parsed = parseImageFullInput(args, callId, (w) => loggerLog("info", `[acp-image] [${session.id}] ${w}`)); - if (!parsed) { - bumpFailStreak(session); - return toolFail(`${IMAGE_FULL_FAILURE_MARKER} invalid input — expected { ref: "mNNNNN" }${restorableRefsSuffix(session)}`); - } - const wasRestored = isImageFullRestored(session.state, parsed.ref); - const outcome = applyImageFull({ ref: parsed.ref, state: session.state, config }); - session.state = outcome.state; - if (outcome.ok) { - if (session.stats.imageFullFailStreak !== 0) session.stats.imageFullFailStreak = 0; - if (!wasRestored) { - session.stats.imageFullRestores = (session.stats.imageFullRestores ?? 0) + 1; - invalidateForRef(session, parsed.ref); - loggerLog("info", `[acp-image] [${session.id}] image_full ${parsed.ref}: restored to full resolution for the rest of the session`); - } else { - loggerLog("info", `[acp-image] [${session.id}] image_full ${parsed.ref}: already restored (no-op)`); - } - return toolOk(outcome.resultText); - } - bumpFailStreak(session); - loggerLog("info", `[acp-image] [${session.id}] image_full ${parsed.ref}: rejected (${outcome.resultText})`); - return toolFail(`${outcome.resultText}${restorableRefsSuffix(session)}`); -} - -/** #3266: plain-text variant served when the host cannot route image_full - * back to us (e.g. codex on the responses wire rejects bili-injected tools - * and records a synthetic "unsupported call" output for them — every - * round-trip forks the host history from ours). The downsampled images stay - * downsampled; the model is told up front so it does not attempt a path - * that can never succeed here. */ -function notRestorableNote(count: number): string { - return `[Downscaled screenshots: ${count} image(s) in this session were reduced before entering context and CANNOT be restored to their original resolution in this session. Read what you can from the reduced images; do not call image_full.]`; -} - -/** Trailing-message guidance for the model: how many images are currently - * downscaled (and not yet restored). Rides as an ephemeral trailing user - * message (nudge pattern) — NEVER in the system prompt, where a changing - * count would bust the whole prefix cache. #3266: carries the actual - * restorable refs (the model previously had to guess), degrades to plain - * text when the host cannot route image_full, and self-suppresses after - * IMAGE_FULL_NOTE_SUPPRESS_STREAK consecutive failures. */ -export function imageFullTrailingNote(session: Session | undefined): string | undefined { - if (!imageCompressionEnabled(session)) return undefined; - const records = session!.state.imageShrinks ?? []; - const active = records.filter((r) => !isImageFullRestored(session!.state, r.ref)).length; - if (active === 0) return undefined; - const refs = restorableRefs(session!); - if (!imageFullRestoreArmed(session) || refs.length === 0) return notRestorableNote(active); - if ((session!.stats.imageFullFailStreak ?? 0) >= IMAGE_FULL_NOTE_SUPPRESS_STREAK) return undefined; - return `${buildImageFullSystemNote(active)}\nRestorable refs (call image_full with exactly one of these): ${formatRefList(refs)}.`; -} - -/** Per-request [acp-usage] suffix: cumulative image savings for the session. - * Gated on bytes OR tokens — the kernel's pixel-tile estimate is coarse and - * capped, so a shrink can save real wire bytes while saving zero tokens. */ -export function imageUsageSuffix(session: Session | undefined): string { - const tok = session?.stats.imageTokensSaved ?? 0; - const bytes = session?.stats.imageBytesSaved ?? 0; - if (tok <= 0 && bytes <= 0) return ""; - return ` img-saved=${tok}tok/${Math.round(bytes / 1024)}KB x${session!.stats.imageShrunkCount ?? 0}`; -} diff --git a/src/loop/core.ts b/src/loop/core.ts index 07f6c9becd..7bba3d6d7b 100644 --- a/src/loop/core.ts +++ b/src/loop/core.ts @@ -23,7 +23,6 @@ import { effectiveAbsorbConfig, executeAbsorb, isProxyToolFor } from "../absorb. import { effectiveRulesEnabled, executeRule } from "../rules-feature.js"; import { ccrEnabled, drainPendingRetrievals, executeRetrieve, retrieveToolName } from "../store.js"; import { recordThreadTail } from "../server/thread-tracking.js"; -import { IMAGE_FULL_TOOL_NAME, executeImageFull, imageCompressionEnabled, imageUsageSuffix } from "../image-compress.js"; import { applyRanges } from "../stream.js"; import { applyConfiguredCompression } from "../external-summary-compress.js"; import { executeSearchContextTarget, resolveDecompress } from "../decompress-shared.js"; @@ -370,9 +369,6 @@ export function executeProxyTool( if (ccrEnabled(ctx.session) && toolName === retrieveToolName(ctx.session)) { return executeRetrieve(args, ctx.session); } - if (imageCompressionEnabled(ctx.session) && toolName === IMAGE_FULL_TOOL_NAME) { - return executeImageFull(args, ctx.session, ctx.config, callId); - } return toolFail(`[Unknown proxy tool: ${toolName}]`); } @@ -396,7 +392,7 @@ function recordUsage( const foldNew = ctx.session.stats.pendingFoldUsage === true; if (foldNew) ctx.session.stats.pendingFoldUsage = false; ctx.log( - `[acp-usage] round ${round} input=${total} ${reportedCached !== null ? `cached=${reportedCached} (cache hit ${hitPct}%)` : "(no cache report)"}${foldNew ? " fold=new" : ""}${total <= 0 ? " (zero-total: lastInputTokens kept)" : ""}${imageUsageSuffix(ctx.session)}`, + `[acp-usage] round ${round} input=${total} ${reportedCached !== null ? `cached=${reportedCached} (cache hit ${hitPct}%)` : "(no cache report)"}${foldNew ? " fold=new" : ""}${total <= 0 ? " (zero-total: lastInputTokens kept)" : ""}`, ); if (total > 0 || reportedCached !== null) { settleUsageReport(ctx.session, { total, reportedCached, output: out, protocol: ctx.protocol, upstream: ctx.upstreamOrigin }); diff --git a/src/persist.ts b/src/persist.ts index 49d71aaa06..6c9ea94fdc 100644 --- a/src/persist.ts +++ b/src/persist.ts @@ -157,12 +157,6 @@ interface PersistedSession { retrieveDelivered?: number; storedBytes?: number; storeBytesSaved?: number; - imageShrunkCount?: number; - imageBytesSaved?: number; - imageTokensSaved?: number; - imageFullCalls?: number; - imageFullRestores?: number; - imageFullFailStreak?: number; rangeRestores?: number; wholeBlockRestores?: number; wholeBlockRestoresPreciseAvailable?: number; @@ -231,11 +225,6 @@ function mergeState(parsed: CompressionState): CompressionState { // resurrects with absorbed=[] and hideAbsorbedMessages has nothing to hide. absorbed: parsed.absorbed ?? fresh.absorbed, rules: parsed.rules ?? fresh.rules, - // #1095: without these, a restart forgets both which refs are restored - // (image_full silently re-downscales them) and the shrink records that - // keep re-encoding deterministic per ref. - imageFullRestored: parsed.imageFullRestored ?? fresh.imageFullRestored, - imageShrinks: parsed.imageShrinks ?? fresh.imageShrinks, }; } @@ -1966,20 +1955,6 @@ function buildSession(parsed: PersistedSession): Session { retrieveDelivered: stats.retrieveDelivered ?? 0, storedBytes: stats.storedBytes ?? 0, storeBytesSaved: stats.storeBytesSaved ?? 0, - imageShrunkCount: stats.imageShrunkCount ?? 0, - imageBytesSaved: stats.imageBytesSaved ?? 0, - imageTokensSaved: stats.imageTokensSaved ?? 0, - imageFullCalls: stats.imageFullCalls ?? 0, - imageFullRestores: stats.imageFullRestores ?? 0, - // #3266: the save path spreads session.stats wholesale but this reader - // restores field-by-field — without the entry a restart silently drops - // the guardrail streak and re-arms the restore note after repeated - // failures (same spread-vs-whitelist gap class as #1724/#2322). - // Presence-preserving on purpose: defaulting absent→0 would materialize - // the key in every reloaded session's stats, changing the persisted - // bytes of sessions that never used image_full (storage corpus / - // render-golden digests pin those bytes). Consumers read `?? 0`. - ...(typeof stats.imageFullFailStreak === "number" && Number.isFinite(stats.imageFullFailStreak) ? { imageFullFailStreak: Math.max(0, stats.imageFullFailStreak) } : {}), rangeRestores: stats.rangeRestores ?? 0, // #1336: retrieval-quality counters (whole-block restores vs cheaper // precise path available) — round-trip so the long-run ratio in diff --git a/src/plugin.ts b/src/plugin.ts index 4f82de0268..b70c18a38d 100644 --- a/src/plugin.ts +++ b/src/plugin.ts @@ -21,7 +21,6 @@ import { normalizeSseLineEndings, finalizeSseLineEndings } from "./sse-util.js"; import { composeStreamFilters, containsBiliInternalText, containsEchoResidue, containsMarkerLineText, containsRenderTagText, containsToolCallEmissionText, containsToolCallXmlFragment, createBiliArtifactFilter, createIdentityStreamFilter, createMarkerLineFilter, createTagEchoFilter, isOrphanMarkupText, mayStartBiliInternal, mayStartDegenerateRenderTag, mayStartMarkerLine, mayStartRenderTag, mayStartToolCallEmission, stripAcpTags, stripAnthropicText, stripOpenaiChatText, stripResponsesText, type TagEchoFilter } from "./loop/tag-echo-filter.js"; import { log as loggerLog } from "./logger.js"; import { ccrEnabled, ccrLoopConfig, contentStoreOf, retrieveToolName } from "./store.js"; -import { imageUsageSuffix } from "./image-compress.js"; import { emitStreamError, emitUpstreamTruncation } from "./stream-error.js"; import type { TruncationDiag } from "./stream-error.js"; @@ -1055,7 +1054,7 @@ export function forkParentRevisionLegacy(session: Session): string { const messages = session.pluginSnapshot; if (!messages) throw new Error("raw snapshot unavailable"); const store = contentStoreOf(session); - const state = { ...session.state, imageFullRestored: session.state.imageFullRestored ?? [], imageShrinks: session.state.imageShrinks ?? [] }; + const state = { ...session.state }; return forkHash({ sessionId: session.id, messages, state, blockContents: Object.fromEntries(session.blockContents), contentStore: store }); } @@ -1961,7 +1960,7 @@ export function applyUsageSample(session: Session, sample: UsageSample, protocol const hit = reportedCached === null ? undefined : Math.round((100 * reportedCached) / total); const foldNew = session.stats.pendingFoldUsage === true; if (foldNew) session.stats.pendingFoldUsage = false; - loggerLog("info", `[${session.id}] [plugin] [acp-usage] input=${total} ${reportedCached === null ? "(no cache report)" : `cached=${reportedCached} (cache hit ${hit}%)`}${foldNew ? " fold=new" : ""}${imageUsageSuffix(session)}`); + loggerLog("info", `[${session.id}] [plugin] [acp-usage] input=${total} ${reportedCached === null ? "(no cache report)" : `cached=${reportedCached} (cache hit ${hit}%)`}${foldNew ? " fold=new" : ""}`); settleUsageReport(session, { total, reportedCached, output: sample.outputTokens, protocol, upstream: upstreamOrigin }); } if (sample.outputTokens !== undefined) session.stats.outputTokens += sample.outputTokens; diff --git a/src/server.ts b/src/server.ts index bef019611b..ba1dc99ef3 100644 --- a/src/server.ts +++ b/src/server.ts @@ -77,7 +77,6 @@ import { ABSORB_TOOL_NAME, COMPRESS_TOOL, BILI_ACP_TOOLS_ANTHROPIC, BILI_ACP_TOO import { absorbEnabled, storeEffectiveAbsorb } from "./absorb.js"; import { ccrEnabled, ccrLoopConfig, ccrPluginWireOk, contentStoreOf, executeRetrieve, pruneExpiredRetrievals, reconcileReloadedRetrievals, renderRetrievalNotes, retrieveToolName, snapshotPendingRetrievals, snapshotRetrievalNotes, storeEffectiveCcr, type CcrSettings } from "./store.js"; import { buildIncomingImageIndex, pruneRetrieveImgExports } from "./image-restore.js"; -import { imageCompressionEnabled, storeEffectiveImageCompression, type ImageCompressionSettings } from "./image-compress.js"; import { rulesEnabled, storeEffectiveRules } from "./rules-feature.js"; import { storeEffectiveSearchPlanAware } from "./decompress-shared.js"; import { armAutoFoldBackoff, autoFoldEngaged, AUTO_FOLD_BACKOFF_MS, externalQueueDroppedAll, withExternalSummaryTools } from "./external-summary-surface.js"; diff --git a/src/server/handle.ts b/src/server/handle.ts index ed5944e376..4eba59b18b 100644 --- a/src/server/handle.ts +++ b/src/server/handle.ts @@ -19,7 +19,6 @@ import { durableMessageToolPaths, withDurableProtection } from "../durable-messa import { biliToolsDeclaredOnWire, countBiliToolUses, evaluateSelfHealRound, pluginLaneDegraded, pluginLaneRestore } from "../session-self-heal.js"; import { acquireInFlight, getSession, hasProcessedState, markDirty, peekSession, releaseInFlight, storeEffectiveConfig, tickPostRebuildAnchor, withSessionLock, type Session } from "../session.js"; import { buildCompressSystemPrompt } from "../compress-tool.js"; -import { storeEffectiveImageCompression, storeImageFullRestoreArmed, type ImageCompressionSettings } from "../image-compress.js"; import { storeEffectiveSearchPlanAware } from "../decompress-shared.js"; import { externalSummaryEnabled } from "../external-summary-surface.js"; import { estimateRawBodyTokens } from "../preflight.js"; @@ -569,7 +568,6 @@ async function handleRequest( // merge); resolved before the session is bound, then stamped onto it below so // every view / injection / execution site reads one value. let resolvedCcrCfg: CcrSettings | undefined; - let resolvedImageCompressionCfg: ImageCompressionSettings | undefined; // [#1336] host-only plan-aware search flag for this request scope (three- // level merge); stamped onto the session below like the other per-request // policies. Off unless compress.search.planAware=true at some level. @@ -721,7 +719,6 @@ async function handleRequest( // arms. Turn it on only by setting compress.ccr.enabled=true at // some config level, after local verification. resolvedCcrCfg = compressCfg.ccr; - resolvedImageCompressionCfg = compressCfg.imageCompression; resolvedSearchPlanAware = compressCfg.search?.planAware === true; reqPrompts = resolveCompressPrompts(compressCfg); const surfaceRes = resolveCompressSurfaceDetailed(compressCfg); @@ -1645,7 +1642,7 @@ async function handleRequest( const pluginCcrStamp = pluginMode ? (ccrPluginWireOk(protocol) && opts.compress.ccr?.enabled === true ? opts.compress.ccr : undefined) : (resolvedCcrCfg?.enabled === true ? resolvedCcrCfg : undefined); - // [#3272/#3266] Same structural gate as image_full's restore channel (#3270): + // [#3272/#3266] Same structural gate as the removed image_full restore channel (#3270): // the codex host rejects bili-injected tools at its tool router and records a // synthetic "unsupported call" output in its own resent history — every // acp_retrieve round-trip permanently forks that history from ours (prefix-cache @@ -1654,23 +1651,6 @@ async function handleRequest( // placeholder is ever emitted; regular compress/decompress folding is unaffected // (the codex lane simply keeps large tool results verbatim until they are folded). storeEffectiveCcr(session, opts.compress.injectTool && storeChannelOk && !(protocol === "responses" && isCodexClient(req.headers)) ? pluginCcrStamp : undefined); - // [#1095] same channel/plugin-mode gating as CCR: image_full's restore - // round-trip needs a tool channel on this wire; without one the model - // could request originals it never gets back (silent-loss trap). - const imageCompressionStamped = opts.compress.injectTool && !pluginMode && storeChannelOk && resolvedImageCompressionCfg?.enabled === true; - storeEffectiveImageCompression(session, imageCompressionStamped ? resolvedImageCompressionCfg : undefined); - // [#3266] downsample pass and restore channel are gated separately. The - // codex host rejects bili-injected tools at its tool router and records - // a synthetic "unsupported call" output for them in its own history — - // every round-trip permanently forks the client's resent history from - // ours (prefix-cache collapse) and even a correct ref is logged - // unsupported there. Keep downsampling (the token saving) but do not - // advertise a restore path that can never succeed on that host. - // The write is deliberately UNCONDITIONAL (not guarded like the reader's - // armed-default): a non-image-stamped session must come out DISARMED, - // else the armed-on-absent default would advertise image_full on wires - // whose intended surface excludes it (wire-contract D pins that). - storeImageFullRestoreArmed(session, imageCompressionStamped && !(protocol === "responses" && isCodexClient(req.headers))); // [#1336] no channel gating: search_context is already available on // whichever mode served this session and the re-rank is pure output- // side policy on its result — both proxy and plugin lanes apply it. diff --git a/src/server/pi-subagent-channel.ts b/src/server/pi-subagent-channel.ts index 2f6d352676..158fbf3a4f 100644 --- a/src/server/pi-subagent-channel.ts +++ b/src/server/pi-subagent-channel.ts @@ -60,7 +60,6 @@ const BILI_INJECTABLE_TOOL_NAMES = new Set([ "acp_rule", "acp_retrieve", "absorb", - "image_full", ]); // module-local type: only this file's exported detectors return it (internal-only export diff --git a/src/server/prepare-anthropic.ts b/src/server/prepare-anthropic.ts index d597b2d8f9..dc30174024 100644 --- a/src/server/prepare-anthropic.ts +++ b/src/server/prepare-anthropic.ts @@ -13,10 +13,9 @@ import { nudgeSuppressed } from "../session-self-heal.js"; import { compressBreakerArmed } from "../stream.js"; import { applyCompactionArchive, coveredRealHistoryIds, detectUnannouncedHistoryRewrite, foldCoverage, markCompactionBoundary, markDirty, markNativeCompactionBoundary, reconcileNativeCompactionBoundary, REWRITE_MIN_INCOMING_TOTAL, snapshotMessages, type PendingRetrieval, type Session } from "../session.js"; import { carriesDshLocalCompactionSummary, DSH_LOCAL_COMPACTION_MIN_MISSING } from "./dsh-compaction-guard.js"; -import { ABSORB_TOOL_NAME, IMAGE_FULL_TOOL, RULE_TOOL, absorbToolsFor, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; +import { ABSORB_TOOL_NAME, RULE_TOOL, absorbToolsFor, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; import { applyAbsorbView, storeEffectiveAbsorb } from "../absorb.js"; import { adoptContentStore, ccrEnabled, ccrLoopConfig, contentStoreOf, dropRetrievals, pruneExpiredRetrievals, reconcileReloadedRetrievals, renderRetrievalNotes, retrieveToolName, snapshotPendingRetrievals, snapshotRetrievalNotes } from "../store.js"; -import { applyImageCompressionPass, imageCompressionEnabled, imageFullRestoreArmed, imageFullTrailingNote } from "../image-compress.js"; import { rulesEnabled, storeEffectiveRules } from "../rules-feature.js"; import { autoFoldEngaged, externalSummaryEnabled, growthFoldingArmed } from "../external-summary-surface.js"; import { attachSubagentSessions } from "../subagent-sessions.js"; @@ -289,10 +288,6 @@ export async function prepareAnthropic( } applyCompactionArchive(session, activeBefore, new Set(msgs.map((m) => m.id)), log); reapOrphansLogged(session, msgs, log, sessionId); - // [#1095] downscale screenshot-like images ONCE at arrival (kernel routing - // decision + recipe; originals cached for the image_full restore channel). - // Deterministic encode ⇒ re-runs are byte-stable for the prefix cache. - await applyImageCompressionPass(session, processedMessages as BiliMessage[], { config, billing: imageBillingFor(opts, upstreamOrigin), cap: imageTokenCapFor(opts, upstreamOrigin), log }); // [#1271/#1343] plugin mode: acp_retrieve already acked via the tool API; snapshot // the queued full text onto THIS forward (stays in the queue until commit/drop, so an // upstream failure drops-and-logs it instead of vanishing it). @@ -328,7 +323,7 @@ export async function prepareAnthropic( // the compress prompt on round-2, the exact F2 seam the matrix pins). systemOut = stampAnthropicSystemCacheControl(systemOut, anthropicCacheMarks !== undefined); if (injectTools) { - toolsOut = injectTool(parsed.tools, [...(absorbActive ? [absorbTools.anthropic] : []), ...(rulesActive ? [RULE_TOOL] : []), ...(ccrEnabled(session) ? [retrieveToolsFor(retrieveToolName(session)).anthropic] : []), ...(imageCompressionEnabled(session) && imageFullRestoreArmed(session) ? [IMAGE_FULL_TOOL] : [])], surface?.toolPrompts, ccrEnabled(session), externalSummaryEnabled(config)); // #3266: restore channel needs the active downsample pass AND a routable host lane + toolsOut = injectTool(parsed.tools, [...(absorbActive ? [absorbTools.anthropic] : []), ...(rulesActive ? [RULE_TOOL] : []), ...(ccrEnabled(session) ? [retrieveToolsFor(retrieveToolName(session)).anthropic] : [])], surface?.toolPrompts, ccrEnabled(session), externalSummaryEnabled(config)); } // Nudge as a separate trailing user message (cache-friendly): the // system block stays byte-stable so the prefix cache survives. @@ -394,10 +389,6 @@ export async function prepareAnthropic( } } } - // [#1095] restore-channel guidance — ephemeral trailing user message - // (see prepareAnthropic for why not system). - const imgNote = imageFullTrailingNote(session); - if (imgNote) rebuiltMessages = [...rebuiltMessages, { role: "user", content: imgNote }]; // [#1343/#1457] surface any earlier undelivered retrieve as an ephemeral // trailing user note (kept last so it never reorders cached messages). // Snapshot WITHOUT consuming: forward() commits the ids only once diff --git a/src/server/prepare-google.ts b/src/server/prepare-google.ts index c0384eda29..462b8fe00a 100644 --- a/src/server/prepare-google.ts +++ b/src/server/prepare-google.ts @@ -13,10 +13,9 @@ import { compressBreakerArmed } from "../stream.js"; import { applyCompactionArchive, coveredRealHistoryIds, detectUnannouncedHistoryRewrite, foldCoverage, markCompactionBoundary, markDirty, markNativeCompactionBoundary, reconcileNativeCompactionBoundary, REWRITE_MIN_INCOMING_TOTAL, snapshotMessages, type Session } from "../session.js"; import { recordConflict } from "../conflict-watch.js"; import { carriesDshLocalCompactionSummary, DSH_LOCAL_COMPACTION_MIN_MISSING } from "./dsh-compaction-guard.js"; -import { ABSORB_TOOL_NAME, IMAGE_FULL_TOOL_GOOGLE, RULE_TOOL_GOOGLE, absorbToolsFor, buildAbsorbSystemPrompt, buildAcpTagsOnlyPrompt, buildCompressSystemPrompt, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; +import { ABSORB_TOOL_NAME, RULE_TOOL_GOOGLE, absorbToolsFor, buildAbsorbSystemPrompt, buildAcpTagsOnlyPrompt, buildCompressSystemPrompt, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; import { absorbToolName, applyAbsorbView, storeEffectiveAbsorb } from "../absorb.js"; import { adoptContentStore, ccrEnabled, ccrLoopConfig, contentStoreOf, retrieveToolName } from "../store.js"; -import { applyImageCompressionPass, imageCompressionEnabled, imageFullRestoreArmed, imageFullTrailingNote } from "../image-compress.js"; import { rulesEnabled, storeEffectiveRules } from "../rules-feature.js"; import { autoFoldEngaged, externalSummaryEnabled, growthFoldingArmed } from "../external-summary-surface.js"; import { attachSubagentSessions } from "../subagent-sessions.js"; @@ -216,8 +215,6 @@ export async function prepareGoogle( } applyCompactionArchive(session, activeBefore, new Set(msgs.map((m) => m.id)), log); reapOrphansLogged(session, msgs, log, sessionId); - // [#1095] arrival-time image downscale (see prepareAnthropic). - await applyImageCompressionPass(session, processedMessages as BiliMessage[], { config, billing: imageBillingFor(opts, upstreamOrigin), cap: imageTokenCapFor(opts, upstreamOrigin), log }); rebuiltContents = coreToGoogle(processedMessages as BiliMessage[]); // ONLY the static compress prompt joins the client's system text — the @@ -245,7 +242,7 @@ export async function prepareGoogle( const extraSystemParts = sysParts.slice(googleClientSystem ? 1 : 0); systemInstruction = extraSystemParts.length > 0 ? { parts: sysParts.map((text) => ({ text })) } : parsed.systemInstruction; if (injectTools) { - toolsOut = injectGoogleTool(parsed.tools, [...(absorbActive ? [absorbTools.google] : []), ...(rulesActive ? [RULE_TOOL_GOOGLE] : []), ...(ccrEnabled(session) ? [retrieveToolsFor(retrieveToolName(session)).google] : []), ...(imageCompressionEnabled(session) && imageFullRestoreArmed(session) ? [IMAGE_FULL_TOOL_GOOGLE] : [])], surface?.toolPrompts, ccrEnabled(session), externalSummaryEnabled(config)); // #3266: restore channel needs the active downsample pass AND a routable host lane + toolsOut = injectGoogleTool(parsed.tools, [...(absorbActive ? [absorbTools.google] : []), ...(rulesActive ? [RULE_TOOL_GOOGLE] : []), ...(ccrEnabled(session) ? [retrieveToolsFor(retrieveToolName(session)).google] : [])], surface?.toolPrompts, ccrEnabled(session), externalSummaryEnabled(config)); } if (sysNotes.length > 0) { rebuiltContents = appendGoogleNudge(rebuiltContents, sysNotes.join("\n\n---\n\n")); @@ -303,9 +300,6 @@ export async function prepareGoogle( } } } - // [#1095] restore-channel guidance — ephemeral trailing note (see prepareAnthropic). - const imgNote = imageFullTrailingNote(session); - if (imgNote) rebuiltContents = appendGoogleNudge(rebuiltContents, imgNote); } catch (err) { log("warn", `[${sessionId}] kernel transform failed, forwarding unchanged: ${String(err)}`); processedMessages = []; diff --git a/src/server/prepare-openai.ts b/src/server/prepare-openai.ts index e047fb8099..0f60d8d0ab 100644 --- a/src/server/prepare-openai.ts +++ b/src/server/prepare-openai.ts @@ -14,10 +14,9 @@ import { nudgeSuppressed } from "../session-self-heal.js"; import { compressBreakerArmed } from "../stream.js"; import { applyCompactionArchive, coveredRealHistoryIds, detectUnannouncedHistoryRewrite, foldCoverage, markCompactionBoundary, markDirty, markNativeCompactionBoundary, reconcileNativeCompactionBoundary, REWRITE_MIN_INCOMING_TOTAL, snapshotMessages, type PendingRetrieval, type Session } from "../session.js"; import { carriesDshLocalCompactionSummary, DSH_LOCAL_COMPACTION_MIN_MISSING } from "./dsh-compaction-guard.js"; -import { ABSORB_TOOL_NAME, IMAGE_FULL_TOOL_OPENAI, RULE_TOOL_OPENAI, absorbToolsFor, buildAbsorbSystemPrompt, buildAcpTagsOnlyPrompt, buildCompressSystemPrompt, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; +import { ABSORB_TOOL_NAME, RULE_TOOL_OPENAI, absorbToolsFor, buildAbsorbSystemPrompt, buildAcpTagsOnlyPrompt, buildCompressSystemPrompt, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; import { absorbToolName, applyAbsorbView, storeEffectiveAbsorb } from "../absorb.js"; import { adoptContentStore, ccrEnabled, ccrLoopConfig, contentStoreOf, dropRetrievals, pruneExpiredRetrievals, reconcileReloadedRetrievals, renderRetrievalNotes, retrieveToolName, snapshotPendingRetrievals, snapshotRetrievalNotes } from "../store.js"; -import { applyImageCompressionPass, imageCompressionEnabled, imageFullRestoreArmed, imageFullTrailingNote } from "../image-compress.js"; import { rulesEnabled, storeEffectiveRules } from "../rules-feature.js"; import { autoFoldEngaged, externalSummaryEnabled, growthFoldingArmed } from "../external-summary-surface.js"; import { attachSubagentSessions } from "../subagent-sessions.js"; @@ -237,9 +236,6 @@ export async function prepareOpenai( } applyCompactionArchive(session, activeBefore, new Set(msgs.map((m) => m.id)), log); reapOrphansLogged(session, msgs, log, sessionId); - // [#1095] arrival-time image downscale (see prepareAnthropic) — one - // deterministic encode per fingerprint; byte-stable re-runs. - await applyImageCompressionPass(session, processedMessages as BiliMessage[], { config, billing: imageBillingFor(opts, billingUpstream ?? upstreamOrigin), cap: imageTokenCapFor(opts, billingUpstream ?? upstreamOrigin), log }); // [#1271/#1343] plugin mode: acp_retrieve already acked via the tool API; snapshot // the queued full text onto THIS forward (stays in the queue until commit/drop, so an // upstream failure drops-and-logs it instead of vanishing it). @@ -276,7 +272,7 @@ export async function prepareOpenai( // avoids double-counting it. openaiOutboundSystem = sysParts.join("\n\n"); if (injectTools) { - toolsOut = injectOpenaiTool(parsed.tools, [...(absorbActive ? [absorbTools.openai] : []), ...(rulesActive ? [RULE_TOOL_OPENAI] : []), ...(ccrEnabled(session) ? [retrieveToolsFor(retrieveToolName(session)).openai] : []), ...(imageCompressionEnabled(session) && imageFullRestoreArmed(session) ? [IMAGE_FULL_TOOL_OPENAI] : [])], surface?.toolPrompts, ccrEnabled(session), externalSummaryEnabled(config)); // #3266: restore channel needs the active downsample pass AND a routable host lane + toolsOut = injectOpenaiTool(parsed.tools, [...(absorbActive ? [absorbTools.openai] : []), ...(rulesActive ? [RULE_TOOL_OPENAI] : []), ...(ccrEnabled(session) ? [retrieveToolsFor(retrieveToolName(session)).openai] : [])], surface?.toolPrompts, ccrEnabled(session), externalSummaryEnabled(config)); } // Nudge as a separate trailing user message (cache-friendly). Injected // in BOTH modes (#451): plugin agents supply the ACP tools but have no @@ -344,10 +340,6 @@ export async function prepareOpenai( } } } - // [#1095] restore-channel guidance — ephemeral trailing user message - // (same pattern as prepareAnthropic/Google/Responses). - const imgNote = imageFullTrailingNote(session); - if (imgNote) rebuiltMessages = [...rebuiltMessages, { role: "user", content: imgNote }]; // [#1343/#1457] surface any earlier undelivered retrieve as an ephemeral // trailing user note (kept last so it never reorders cached messages). // Snapshot WITHOUT consuming: forward() commits the ids only once diff --git a/src/server/prepare-responses.ts b/src/server/prepare-responses.ts index 76e0411eb7..37ad1a87bd 100644 --- a/src/server/prepare-responses.ts +++ b/src/server/prepare-responses.ts @@ -17,10 +17,9 @@ import { compressBreakerArmed } from "../stream.js"; import { coveredRealHistoryIds, foldCoverage, markDirty, markNativeCompactionBoundary, reconcileNativeCompactionBoundary, REWRITE_MIN_INCOMING_TOTAL, snapshotMessages, type Session } from "../session.js"; import { carriesDshLocalCompactionSummary, DSH_LOCAL_COMPACTION_MIN_MISSING } from "./dsh-compaction-guard.js"; import { recordConflict } from "../conflict-watch.js"; -import { ABSORB_TOOL_NAME, BILI_ACP_READONLY_TOOLS_RESPONSES, BILI_ACP_READONLY_TOOLS_RESPONSES_NO_RANGE, BILI_ACP_TOOLS_RESPONSES, BILI_ACP_TOOLS_RESPONSES_NO_RANGE, IMAGE_FULL_TOOL_RESPONSES, RULE_TOOL_RESPONSES, absorbToolsFor, buildAbsorbSystemPrompt, buildAcpTagsOnlyPrompt, buildCompressHybridSystemPrompt, buildCompressSystemPrompt, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; +import { ABSORB_TOOL_NAME, BILI_ACP_READONLY_TOOLS_RESPONSES, BILI_ACP_READONLY_TOOLS_RESPONSES_NO_RANGE, BILI_ACP_TOOLS_RESPONSES, BILI_ACP_TOOLS_RESPONSES_NO_RANGE, RULE_TOOL_RESPONSES, absorbToolsFor, buildAbsorbSystemPrompt, buildAcpTagsOnlyPrompt, buildCompressHybridSystemPrompt, buildCompressSystemPrompt, retrieveToolsFor, withFirstSightDrain, withMarkerIntegrityNote, withSummaryBudgetNote } from "../compress-tool.js"; import { absorbToolName, applyAbsorbView, storeEffectiveAbsorb } from "../absorb.js"; import { adoptContentStore, ccrEnabled, ccrLoopConfig, contentStoreOf, retrieveToolName } from "../store.js"; -import { applyImageCompressionPass, imageCompressionEnabled, imageFullRestoreArmed, imageFullTrailingNote } from "../image-compress.js"; import { rulesEnabled, storeEffectiveRules } from "../rules-feature.js"; import { autoFoldEngaged, externalSummaryEnabled, growthFoldingArmed } from "../external-summary-surface.js"; import { attachSubagentSessions } from "../subagent-sessions.js"; @@ -319,8 +318,6 @@ export async function prepareResponses( log("info", diagNudge(turn, sessionId, tokenCount, config.modelContextLimit, parsed.model, willInjectNudge, decideTier1Arm && !decideFallbackOverride)); processedMessages = repairResponsesAssistantOrdering(applyReasoningDrop(stripKernelSummaries(turn.messages, turn.state), reasoningPlan, log, sessionId), originalMessages); reapOrphansLogged(session, msgs, log, sessionId); - // [#1095] arrival-time image downscale (see prepareAnthropic). - await applyImageCompressionPass(session, processedMessages as BiliMessage[], { config, billing: imageBillingFor(opts, billingUpstream ?? upstreamOrigin), cap: imageTokenCapFor(opts, billingUpstream ?? upstreamOrigin), log }); rebuiltInput = patchResponsesInput(projection, processedMessages); if (Array.isArray(rebuiltInput)) rebuiltInput = mergeAdjacentConfigurationUpdates(hoistTrappedToolItems(rebuiltInput)); // Fallback path: when the echo did NOT come back this turn (client @@ -348,7 +345,7 @@ export async function prepareResponses( // #1712: decompress's startId/endId execute only on CCR-armed // sessions (#1179) — serve the no-range schema otherwise. const ccrOn = ccrEnabled(session); - const respExtra = [...(absorbActive ? [absorbTools.responses] : []), ...(rulesActive ? [RULE_TOOL_RESPONSES] : []), ...(ccrOn ? [retrieveToolsFor(retrieveToolName(session)).responses] : []), ...(imageCompressionEnabled(session) && imageFullRestoreArmed(session) ? [IMAGE_FULL_TOOL_RESPONSES] : [])]; // #3266: restore channel needs the active downsample pass AND a routable host lane + const respExtra = [...(absorbActive ? [absorbTools.responses] : []), ...(rulesActive ? [RULE_TOOL_RESPONSES] : []), ...(ccrOn ? [retrieveToolsFor(retrieveToolName(session)).responses] : [])]; toolsOut = responsesTextProtocol ? injectResponsesTool(parsed.tools, ccrOn ? BILI_ACP_READONLY_TOOLS_RESPONSES : BILI_ACP_READONLY_TOOLS_RESPONSES_NO_RANGE, surface?.toolPrompts, externalSummaryEnabled(config)) : injectResponsesTool(parsed.tools, respExtra.length > 0 ? [...(ccrOn ? BILI_ACP_TOOLS_RESPONSES : BILI_ACP_TOOLS_RESPONSES_NO_RANGE), ...respExtra] : (ccrOn ? BILI_ACP_TOOLS_RESPONSES : BILI_ACP_TOOLS_RESPONSES_NO_RANGE), surface?.toolPrompts, externalSummaryEnabled(config)); @@ -448,19 +445,6 @@ export async function prepareResponses( } } } - // [#1095] restore-channel guidance — ephemeral trailing note (see - // prepareAnthropic). Never after a compaction_trigger: that item must - // stay the final input item (#283/#209), and the forge path for trigger - // requests builds its own body anyway. - const imgNote = imageFullTrailingNote(session); - if (imgNote && !isCompactionTrigger) { - const inputItems: ResponseInputItem[] = typeof rebuiltInput === "string" - ? [{ type: "message", role: "user", content: rebuiltInput }] - : rebuiltInput; - inputItems.push({ type: "message", role: "user", content: imgNote }); - rebuiltInput = inputItems; - log("debug", `[${sessionId}] [inject] image-full restore note appended as trailing user turn (${imgNote.length} chars)`); - } transformOk = true; } catch (err) { log("warn", `[${sessionId}] kernel transform failed, forwarding unchanged: ${String(err)}`); diff --git a/src/server/relay.ts b/src/server/relay.ts index aa84b083a7..55b8a2f6c0 100644 --- a/src/server/relay.ts +++ b/src/server/relay.ts @@ -23,7 +23,6 @@ import { externalSummaryEnabled } from "../external-summary-surface.js"; import { fakeBufCap, injectFakeCompletionHint, isFakeCompletion, maxFakeCompletionRetries } from "../fake-completion.js"; import { fetchWithTimeout, fetchWithTransportRetry } from "../fetch-util.js"; import { currentFetchTransport } from "../fetch-transport.js"; -import { applyImageCompressionPass, imageFullTrailingNote, imageUsageSuffix } from "../image-compress.js"; import { countImagesInRawBody, upstreamHost } from "../image-tokens.js"; import { log as loggerLog } from "../logger.js"; import { dumpReqAllowed as knobDumpReqAllowed, rawDumpDir as knobRawDumpDir } from "../knobs.js"; @@ -1482,13 +1481,6 @@ export async function forward( // byte prefix broke mid-history on every fold. const dropped = prepared.dropReasoning ? prepared.dropReasoning(out) : out; const ordered = prepared.protocol === "responses" ? repairResponsesAssistantOrdering(dropped, prepared.originalMessages) : dropped; - // [#1095] the folded re-request must carry the SAME bytes the - // model saw (deterministic encode + per-fingerprint cache) — - // applied after the ordering repair, matching the steady - // paths' sequence. - await applyImageCompressionPass(prepared.session, ordered as BiliMessage[], { config: loopConfig, billing: imageBillingFor(opts, route?.rewrittenUrl), cap: imageTokenCapFor(opts, route?.rewrittenUrl), log: ctx.log }); - const imgNote = imageFullTrailingNote(prepared.session); - if (imgNote) (ordered as BiliMessage[]).push({ id: "bili_image_full_note", role: "user", contentType: "text", text: imgNote }); return ordered; }); }; @@ -1591,7 +1583,7 @@ export async function forward( settleUsageReport(prepared.session, { total: billed, reportedCached, output: out, protocol: prepared.protocol, upstream: targetOrigin }); if (reportedCached !== null) warnCacheCollapse(prepared.session, billed, reportedCached); const hitPct = reportedCached !== null && billed > 0 ? Math.round((100 * reportedCached) / billed) : undefined; - loggerLog("info", `[${prepared.session.id}] [acp-usage] input=${billed} ${hitPct === undefined ? "(no cache report)" : `cached=${reportedCached} (cache hit ${hitPct}%)`}${billed <= 0 ? " (zero-total: lastInputTokens kept)" : ""}${imageUsageSuffix(prepared.session)}`); + loggerLog("info", `[${prepared.session.id}] [acp-usage] input=${billed} ${hitPct === undefined ? "(no cache report)" : `cached=${reportedCached} (cache hit ${hitPct}%)`}${billed <= 0 ? " (zero-total: lastInputTokens kept)" : ""}`); } else { diagnoseSuccessWithoutUsage(prepared.session, "proxy-json"); } diff --git a/src/server/side-request.ts b/src/server/side-request.ts index d3ca6e10a5..74800e527b 100644 --- a/src/server/side-request.ts +++ b/src/server/side-request.ts @@ -3,7 +3,7 @@ import { estimateRawBodyTokens } from "../preflight.js"; import { imageTokensInParsedBody } from "../image-tokens.js"; import { reserveOutputHeadroom, shouldReserveOutputHeadroom, systemCarrierTexts } from "../util.js"; import { type ResolvedImageBilling } from "../image-tokens.js"; -import { ACP_TOOL_NAMES, ABSORB_TOOL_NAME, IMAGE_FULL_TOOL_NAME, RETRIEVE_TOOL_NAME, RULE_TOOL_NAME } from "acp-kernel"; +import { ACP_TOOL_NAMES, ABSORB_TOOL_NAME, RETRIEVE_TOOL_NAME, RULE_TOOL_NAME } from "acp-kernel"; // #388: side requests (title-gen etc.) share the main session key but must not // touch kernel state. Identified by a tiny output budget (same heuristic as @@ -188,7 +188,6 @@ export const BILI_TOOL_NAMES: ReadonlySet = new Set([ ABSORB_TOOL_NAME, RULE_TOOL_NAME, RETRIEVE_TOOL_NAME, - IMAGE_FULL_TOOL_NAME, ]); /** Tool names declared by `parsed.tools`, proto-agnostically. null when the diff --git a/src/session.ts b/src/session.ts index 30a55ed101..86396bd820 100644 --- a/src/session.ts +++ b/src/session.ts @@ -1,4 +1,4 @@ -import { createInitialState, defaultConfig, highestUsedIndex, indexToRef, resetImageFullState, type CompressionState, type Config, type CoreMessage, type MessageContentStore, type NudgeDecision } from "acp-kernel"; +import { createInitialState, defaultConfig, highestUsedIndex, indexToRef, type CompressionState, type Config, type CoreMessage, type MessageContentStore, type NudgeDecision } from "acp-kernel"; import { createHash } from "node:crypto"; import { log as loggerLog } from "./logger.js"; import { getStore, effectiveFileStorageMode } from "./persist.js"; @@ -466,22 +466,6 @@ export type Session = { storedBytes: number; /** #1097: cumulative wire bytes saved by placeholder substitution. */ storeBytesSaved: number; - /** #1095: image blocks downscaled this session (lifetime; optional — - * absent in pre-#1095 records). */ - imageShrunkCount?: number; - /** #1095: cumulative wire bytes saved by downscaling. */ - imageBytesSaved?: number; - /** #1095: cumulative estimated visual tokens saved by downscaling. */ - imageTokensSaved?: number; - /** #1095: total image_full tool calls issued. */ - imageFullCalls?: number; - /** #1095: image_full calls that restored a downscaled ref. */ - imageFullRestores?: number; - /** #3266: consecutive image_full failures (parse or rejection); reset - * to 0 on any success. At >= 2 the restore note is suppressed — a - * model that keeps failing with refs it guesses needs the loop to - * stop, not another nudge per round. */ - imageFullFailStreak?: number; /** #1179 CCR v2: range-level decompress restores served (ephemeral channel). */ rangeRestores: number; /** #1336: whole-block decompress restores served. Optional — absent in @@ -571,16 +555,7 @@ export type Session = { * pruneRetrieveImgExports sweep for this session (throttled to once a * minute in the request path). */ lastImgPrune?: number; - /** #1095 in-memory only (NOT persisted): deterministic encode cache keyed - * by sha256 of the ORIGINAL base64 → encoded payload. Identical inputs - * must yield identical wire bytes across turns/restarts (prefix-cache - * invariant), so this is a pure CPU cache, never a correctness source. */ - imageEncodeCache?: Map; - /** #1095 in-memory only (NOT persisted): sha256 fingerprints of the - * original payloads shrunk per ref — lets image_full invalidate the exact - * encode-cache entries a restored ref contributed. */ - imageFingerprintsByRef?: Map; - /** Number of in-flight requests using this session. A session with + /** Number of in-flight requests using this session. A session with * inFlight > 0 must NOT be LRU-evicted: evicting it mid-stream flushes a * half-mutated snapshot and then a miss reloads a SECOND Session object, * causing split-brain writes to the same file. See persist.ts M5. */ @@ -1247,10 +1222,7 @@ export function cacheBlockContent(session: Session, blockId: string, content: Bl } export function resetSessionCompression(session: Session): void { - // Kernel contract (acp-kernel image-compress.d.ts): resetImageFullState on - // EVERY state reset — refs are re-issued here, so any surviving - // imageFullRestored/imageShrinks entries would misattribute. - session.state = resetImageFullState(createInitialState()); + session.state = createInitialState(); session.blockContents.clear(); // The kernel contract ties the store to the state ('host resets the store // with the state'): a full rebase restarts refs at m00001, so old entries @@ -1266,10 +1238,6 @@ export function resetSessionCompression(session: Session): void { delete session.metadata.ccrUndelivered; delete session.metadata.ccrDropNotes; session.ccrReconcilePending = false; - // #1095: same ref-reissue rationale as the content store — encode-cache / - // fingerprint entries keyed by old refs would misattribute after rebase. - session.imageEncodeCache?.clear(); - session.imageFingerprintsByRef?.clear(); session.stats.lastInputTokens = 0; // #857: a zeroed baseline carries no provenance — drop any stale flag. delete session.stats.lastInputTokensSource; diff --git a/src/storage/ingest.ts b/src/storage/ingest.ts index 2e10bc53ee..429a8a8f57 100644 --- a/src/storage/ingest.ts +++ b/src/storage/ingest.ts @@ -47,8 +47,6 @@ const MERGE_STATE_FIELDS = [ "nextRuleId", "absorbed", "rules", - "imageFullRestored", - "imageShrinks", ] as const; /** Fields owned by dedicated tables/columns — never inside kstate_json. */ diff --git a/src/stream.ts b/src/stream.ts index 19399f45d6..107db53572 100644 --- a/src/stream.ts +++ b/src/stream.ts @@ -8,7 +8,7 @@ import { effectiveAbsorbConfig, executeAbsorb, isProxyToolFor } from "./absorb.j import { executeSearchContextTarget, resolveDecompress } from "./decompress-shared.js"; import { ONE_CALL_HINT } from "acp-kernel"; import { adoptContentStore, contentStoreOf, ccrEnabled, drainPendingRetrievals, executeRetrieve, retrieveToolName } from "./store.js"; -import { IMAGE_FULL_TOOL_NAME, executeImageFull, imageCompressionEnabled } from "./image-compress.js"; +import { recordThreadTail } from "./server/thread-tracking.js"; import { imagePlaceholdersForSummary } from "./image-note.js"; import { containsBiliInternalText, containsMarkerLineText, containsRenderTagText, containsToolCallEmissionText, stripAcpTags } from "./loop/tag-echo-filter.js"; import { maxShrinkPerCompress } from "./fetch-util.js"; @@ -77,11 +77,6 @@ function executeAnthropicProxyTool(toolName: string, args: Record `${acc}\n\n${inj.text}`, ack.text) }; } - if (imageCompressionEnabled(ctx.session) && toolName === IMAGE_FULL_TOOL_NAME) { - // Restore is passive egress behavior (the next forward re-emits the - // cached original), so there is nothing to drain inline. - return executeImageFull(args, ctx.session, ctx.config); - } return toolFail(`[Unknown proxy tool: ${toolName}]`); } diff --git a/tests/fix-1897-leaked-tools-side.test.ts b/tests/fix-1897-leaked-tools-side.test.ts index 4c0afbcbd5..9d98a01a2a 100644 --- a/tests/fix-1897-leaked-tools-side.test.ts +++ b/tests/fix-1897-leaked-tools-side.test.ts @@ -2,7 +2,7 @@ import test from "node:test"; import assert from "node:assert/strict"; import http from "node:http"; import { once } from "node:events"; -import { defaultConfig, createInitialState, IMAGE_FULL_TOOL_NAME } from "acp-kernel"; +import { defaultConfig, createInitialState } from "acp-kernel"; import { startServer, stripLeakedBiliTools, BILI_TOOL_NAMES } from "../src/server.ts"; import type { ProxyOptions } from "../src/config.ts"; import { PROXY_TOOL_NAMES, ABSORB_TOOL_NAME, RETRIEVE_TOOL_NAME, RULE_TOOL_NAME } from "../src/compress-tool.ts"; @@ -59,9 +59,9 @@ test("stripLeakedBiliTools: google functionDeclarations (one entry may declare m }); test("stripLeakedBiliTools: opt-in bili extras count as bili-owned", () => { - const body = { model: "m", tools: [openAiTool(ABSORB_TOOL_NAME), openAiTool(RULE_TOOL_NAME), openAiTool(RETRIEVE_TOOL_NAME), openAiTool(IMAGE_FULL_TOOL_NAME)] }; + const body = { model: "m", tools: [openAiTool(ABSORB_TOOL_NAME), openAiTool(RULE_TOOL_NAME), openAiTool(RETRIEVE_TOOL_NAME)] }; assert.equal(stripLeakedBiliTools(body), true); - for (const n of [ABSORB_TOOL_NAME, RULE_TOOL_NAME, RETRIEVE_TOOL_NAME, IMAGE_FULL_TOOL_NAME]) { + for (const n of [ABSORB_TOOL_NAME, RULE_TOOL_NAME, RETRIEVE_TOOL_NAME]) { assert.ok(BILI_TOOL_NAMES.has(n), `${n} in the bili set`); } }); diff --git a/tests/golden/storage-corpus/ccr/responses/127.0.0.1_0787df32f3cf98f922f7c0f0.json b/tests/golden/storage-corpus/ccr/responses/127.0.0.1_0787df32f3cf98f922f7c0f0.json index 3e33cd7863..63cf88301e 100644 --- a/tests/golden/storage-corpus/ccr/responses/127.0.0.1_0787df32f3cf98f922f7c0f0.json +++ b/tests/golden/storage-corpus/ccr/responses/127.0.0.1_0787df32f3cf98f922f7c0f0.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-ccr","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-ccr","meta":{"protocol":"responses","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-ccr","title":"Corpus corpus-ccr"},"stats":{"requests":2,"tokensSaved":6000,"inputTokens":50000,"cachedTokens":0,"outputTokens":200,"cacheSamples":2,"lastInputTokens":50000,"contextTokens":50000,"contextTokensSource":"estimate","storedBytes":32,"storeBytesSaved":64},"metadata":{"corpus":"corpus-ccr","biliVersion":"0.1.191"},"state":{"blocks":[],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":0,"compressionCount":0,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"imageFullRestored":[],"imageShrinks":[],"nextBlockId":1,"nextRunId":1},"blockContents":{},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-ccr","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-ccr","meta":{"protocol":"responses","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-ccr","title":"Corpus corpus-ccr"},"stats":{"requests":2,"tokensSaved":6000,"inputTokens":50000,"cachedTokens":0,"outputTokens":200,"cacheSamples":2,"lastInputTokens":50000,"contextTokens":50000,"contextTokensSource":"estimate","storedBytes":32,"storeBytesSaved":64},"metadata":{"corpus":"corpus-ccr","biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":0,"compressionCount":0,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"nextBlockId":1,"nextRunId":1},"blockContents":{},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/deadrefs/anthropic/127.0.0.1_e17d4db40407d10867daeb1d.json b/tests/golden/storage-corpus/deadrefs/anthropic/127.0.0.1_e17d4db40407d10867daeb1d.json index 4e99e71d31..45ae98e730 100644 --- a/tests/golden/storage-corpus/deadrefs/anthropic/127.0.0.1_e17d4db40407d10867daeb1d.json +++ b/tests/golden/storage-corpus/deadrefs/anthropic/127.0.0.1_e17d4db40407d10867daeb1d.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-deadrefs","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-deadrefs","meta":{"protocol":"anthropic","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-deadrefs","title":"Corpus corpus-deadrefs"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3,"imageShrunkCount":0,"imageBytesSaved":0,"imageTokensSaved":0},"metadata":{"corpus":"corpus-deadrefs","biliVersion":"0.1.191"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"directBlockIds":[],"compressedTokens":1575,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":1575,"compressionCount":1,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2,"deadRefs":["m00010","m00014"]},"blockContents":{"b1":{"one":null,"full":{"text":"deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-deadrefs","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-deadrefs","meta":{"protocol":"anthropic","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-deadrefs","title":"Corpus corpus-deadrefs"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3},"metadata":{"corpus":"corpus-deadrefs","biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"directBlockIds":[],"compressedTokens":1575,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":1575,"compressionCount":1,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2,"deadRefs":["m00010","m00014"]},"blockContents":{"b1":{"one":null,"full":{"text":"deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 deadrefs fixture fold over raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/folded/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json b/tests/golden/storage-corpus/folded/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json index a58a228c01..e9e527f147 100644 --- a/tests/golden/storage-corpus/folded/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json +++ b/tests/golden/storage-corpus/folded/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-folded","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-folded","meta":{"protocol":"anthropic","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-folded","title":"Corpus corpus-folded"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3,"imageShrunkCount":0,"imageBytesSaved":0,"imageTokensSaved":0},"messages":[{"id":"acp_summary_b1","role":"system","contentType":"text","text":"[Compressed conversation section]\ncorpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20"},{"id":"raw31","role":"user","contentType":"text","text":"message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet "},{"id":"raw32","role":"assistant","contentType":"text","text":"message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet "},{"id":"raw33","role":"user","contentType":"text","text":"message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet "},{"id":"raw34","role":"assistant","contentType":"text","text":"message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet "},{"id":"raw35","role":"user","contentType":"text","text":"message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet "},{"id":"raw36","role":"assistant","contentType":"text","text":"message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet "},{"id":"raw37","role":"user","contentType":"text","text":"message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet "},{"id":"raw38","role":"assistant","contentType":"text","text":"message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet "},{"id":"raw39","role":"user","contentType":"text","text":"message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet "},{"id":"raw40","role":"assistant","contentType":"text","text":"message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet "}],"messagesFolded":true,"metadata":{"corpus":"corpus-folded","biliVersion":"0.1.191"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18"],"directBlockIds":[],"compressedTokens":3870,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030","raw31":"m00031","raw32":"m00032","raw33":"m00033","raw34":"m00034","raw35":"m00035","raw36":"m00036","raw37":"m00037","raw38":"m00038","raw39":"m00039","raw40":"m00040"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30","m00031":"raw31","m00032":"raw32","m00033":"raw33","m00034":"raw34","m00035":"raw35","m00036":"raw36","m00037":"raw37","m00038":"raw38","m00039":"raw39","m00040":"raw40"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":3870,"compressionCount":1,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2},"blockContents":{"b1":{"one":null,"full":{"text":"corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-folded","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-folded","meta":{"protocol":"anthropic","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-folded","title":"Corpus corpus-folded"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3},"messages":[{"id":"raw31","role":"user","contentType":"text","text":"message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet message body raw31 lorem ipsum dolor sit amet "},{"id":"raw32","role":"assistant","contentType":"text","text":"message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet message body raw32 lorem ipsum dolor sit amet "},{"id":"raw33","role":"user","contentType":"text","text":"message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet message body raw33 lorem ipsum dolor sit amet "},{"id":"raw34","role":"assistant","contentType":"text","text":"message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet message body raw34 lorem ipsum dolor sit amet "},{"id":"raw35","role":"user","contentType":"text","text":"message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet message body raw35 lorem ipsum dolor sit amet "},{"id":"raw36","role":"assistant","contentType":"text","text":"message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet message body raw36 lorem ipsum dolor sit amet "},{"id":"raw37","role":"user","contentType":"text","text":"message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet message body raw37 lorem ipsum dolor sit amet "},{"id":"raw38","role":"assistant","contentType":"text","text":"message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet message body raw38 lorem ipsum dolor sit amet "},{"id":"raw39","role":"user","contentType":"text","text":"message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet message body raw39 lorem ipsum dolor sit amet "},{"id":"raw40","role":"assistant","contentType":"text","text":"message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet message body raw40 lorem ipsum dolor sit amet "},{"id":"acp_summary_b1","role":"system","contentType":"text","text":"[Compressed conversation section]\ncorpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20"}],"messagesFolded":true,"metadata":{"corpus":"corpus-folded","biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18"],"directBlockIds":[],"compressedTokens":3870,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030","raw31":"m00031","raw32":"m00032","raw33":"m00033","raw34":"m00034","raw35":"m00035","raw36":"m00036","raw37":"m00037","raw38":"m00038","raw39":"m00039","raw40":"m00040"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30","m00031":"raw31","m00032":"raw32","m00033":"raw33","m00034":"raw34","m00035":"raw35","m00036":"raw36","m00037":"raw37","m00038":"raw38","m00039":"raw39","m00040":"raw40"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":3870,"compressionCount":1,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2},"blockContents":{"b1":{"one":null,"full":{"text":"corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 corpus folded summary of raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/fork-receipt/chat/127.0.0.1_bde31987d03ca1ebaeb96ba0.json b/tests/golden/storage-corpus/fork-receipt/chat/127.0.0.1_bde31987d03ca1ebaeb96ba0.json index 4f36909391..c5108e8c95 100644 --- a/tests/golden/storage-corpus/fork-receipt/chat/127.0.0.1_bde31987d03ca1ebaeb96ba0.json +++ b/tests/golden/storage-corpus/fork-receipt/chat/127.0.0.1_bde31987d03ca1ebaeb96ba0.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-fork-receipt","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-fork-receipt","meta":{"protocol":"chat","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-fork-receipt","title":"Corpus corpus-fork-receipt"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3,"imageShrunkCount":0,"imageBytesSaved":0,"imageTokensSaved":0},"pluginSnapshot":[{"id":"raw1","role":"user","contentType":"text","text":"message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet "},{"id":"raw2","role":"assistant","contentType":"text","text":"message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet "},{"id":"raw3","role":"user","contentType":"text","text":"message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet "},{"id":"raw4","role":"assistant","contentType":"text","text":"message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet "},{"id":"raw5","role":"user","contentType":"text","text":"message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet "},{"id":"raw6","role":"assistant","contentType":"text","text":"message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet "},{"id":"raw7","role":"user","contentType":"text","text":"message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet "},{"id":"raw8","role":"assistant","contentType":"text","text":"message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet "},{"id":"raw9","role":"user","contentType":"text","text":"message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet "},{"id":"raw10","role":"assistant","contentType":"text","text":"message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet "},{"id":"raw11","role":"user","contentType":"text","text":"message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet "},{"id":"raw12","role":"assistant","contentType":"text","text":"message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet "},{"id":"raw13","role":"user","contentType":"text","text":"message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet "},{"id":"raw14","role":"assistant","contentType":"text","text":"message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet "},{"id":"raw15","role":"user","contentType":"text","text":"message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet "},{"id":"raw16","role":"assistant","contentType":"text","text":"message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet "},{"id":"raw17","role":"user","contentType":"text","text":"message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet "},{"id":"raw18","role":"assistant","contentType":"text","text":"message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet "},{"id":"raw19","role":"user","contentType":"text","text":"message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet "},{"id":"raw20","role":"assistant","contentType":"text","text":"message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet "},{"id":"raw21","role":"user","contentType":"text","text":"message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet "},{"id":"raw22","role":"assistant","contentType":"text","text":"message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet "},{"id":"raw23","role":"user","contentType":"text","text":"message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet "},{"id":"raw24","role":"assistant","contentType":"text","text":"message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet "},{"id":"raw25","role":"user","contentType":"text","text":"message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet "},{"id":"raw26","role":"assistant","contentType":"text","text":"message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet "},{"id":"raw27","role":"user","contentType":"text","text":"message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet "},{"id":"raw28","role":"assistant","contentType":"text","text":"message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet "},{"id":"raw29","role":"user","contentType":"text","text":"message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet "},{"id":"raw30","role":"assistant","contentType":"text","text":"message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet "}],"forkContentStore":{"version":1,"byHash":{"270352b3cb850a1385795985ecc07e3a6b2d966e216dd5ab3e553645092162dd":"original tool output corpus-1"},"byRef":{"m00004":{"kind":"tool_result","rawId":"raw4","ref":"m00004","text":"original tool output corpus-1","tokens":40,"chars":27,"head":"original tool output c"}}},"metadata":{"corpus":"corpus-fork-receipt","publicForkReceipt":{"childId":"corpus-fork-child","cutAtRef":"m00015","revision":"593b62e5d25a0c6ac663ca0af5c29699fcc67d50a1427c62c4f0354147238d48","at":1700000000000},"publicSnapshotRetained":true,"publicSnapshotStoredRefs":["m00004"],"biliVersion":"0.1.191"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"directBlockIds":[],"compressedTokens":1575,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":1575,"compressionCount":1,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2},"blockContents":{"b1":{"one":null,"full":{"text":"fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-fork-receipt","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-fork-receipt","meta":{"protocol":"chat","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-fork-receipt","title":"Corpus corpus-fork-receipt"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3},"pluginSnapshot":[{"id":"raw1","role":"user","contentType":"text","text":"message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet "},{"id":"raw2","role":"assistant","contentType":"text","text":"message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet "},{"id":"raw3","role":"user","contentType":"text","text":"message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet "},{"id":"raw4","role":"assistant","contentType":"text","text":"message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet "},{"id":"raw5","role":"user","contentType":"text","text":"message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet "},{"id":"raw6","role":"assistant","contentType":"text","text":"message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet "},{"id":"raw7","role":"user","contentType":"text","text":"message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet "},{"id":"raw8","role":"assistant","contentType":"text","text":"message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet "},{"id":"raw9","role":"user","contentType":"text","text":"message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet "},{"id":"raw10","role":"assistant","contentType":"text","text":"message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet "},{"id":"raw11","role":"user","contentType":"text","text":"message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet "},{"id":"raw12","role":"assistant","contentType":"text","text":"message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet "},{"id":"raw13","role":"user","contentType":"text","text":"message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet "},{"id":"raw14","role":"assistant","contentType":"text","text":"message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet "},{"id":"raw15","role":"user","contentType":"text","text":"message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet "},{"id":"raw16","role":"assistant","contentType":"text","text":"message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet "},{"id":"raw17","role":"user","contentType":"text","text":"message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet "},{"id":"raw18","role":"assistant","contentType":"text","text":"message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet "},{"id":"raw19","role":"user","contentType":"text","text":"message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet "},{"id":"raw20","role":"assistant","contentType":"text","text":"message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet "},{"id":"raw21","role":"user","contentType":"text","text":"message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet "},{"id":"raw22","role":"assistant","contentType":"text","text":"message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet "},{"id":"raw23","role":"user","contentType":"text","text":"message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet "},{"id":"raw24","role":"assistant","contentType":"text","text":"message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet "},{"id":"raw25","role":"user","contentType":"text","text":"message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet "},{"id":"raw26","role":"assistant","contentType":"text","text":"message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet "},{"id":"raw27","role":"user","contentType":"text","text":"message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet "},{"id":"raw28","role":"assistant","contentType":"text","text":"message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet "},{"id":"raw29","role":"user","contentType":"text","text":"message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet "},{"id":"raw30","role":"assistant","contentType":"text","text":"message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet "}],"forkContentStore":{"version":1,"byHash":{"270352b3cb850a1385795985ecc07e3a6b2d966e216dd5ab3e553645092162dd":"original tool output corpus-1"},"byRef":{"m00004":{"kind":"tool_result","rawId":"raw4","ref":"m00004","text":"original tool output corpus-1","tokens":40,"chars":27,"head":"original tool output c"}}},"metadata":{"corpus":"corpus-fork-receipt","publicForkReceipt":{"childId":"corpus-fork-child","cutAtRef":"m00015","revision":"593b62e5d25a0c6ac663ca0af5c29699fcc67d50a1427c62c4f0354147238d48","at":1700000000000},"publicSnapshotRetained":true,"publicSnapshotStoredRefs":["m00004"],"biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"directBlockIds":[],"compressedTokens":1575,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":1575,"compressionCount":1,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2},"blockContents":{"b1":{"one":null,"full":{"text":"fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 fork fixture fold over raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/fork-retained/chat/127.0.0.1_dec59ddccc0b4b89ff346c9b.json b/tests/golden/storage-corpus/fork-retained/chat/127.0.0.1_dec59ddccc0b4b89ff346c9b.json index 6696b3a77c..1e98c47fb2 100644 --- a/tests/golden/storage-corpus/fork-retained/chat/127.0.0.1_dec59ddccc0b4b89ff346c9b.json +++ b/tests/golden/storage-corpus/fork-retained/chat/127.0.0.1_dec59ddccc0b4b89ff346c9b.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-fork-retained","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-fork-retained","meta":{"protocol":"chat","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-fork-retained","title":"Corpus corpus-fork-retained"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3,"imageShrunkCount":0,"imageBytesSaved":0,"imageTokensSaved":0},"pluginSnapshot":[{"id":"raw1","role":"user","contentType":"text","text":"message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet "},{"id":"raw2","role":"assistant","contentType":"text","text":"message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet "},{"id":"raw3","role":"user","contentType":"text","text":"message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet "},{"id":"raw4","role":"assistant","contentType":"text","text":"message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet "},{"id":"raw5","role":"user","contentType":"text","text":"message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet "},{"id":"raw6","role":"assistant","contentType":"text","text":"message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet "},{"id":"raw7","role":"user","contentType":"text","text":"message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet "},{"id":"raw8","role":"assistant","contentType":"text","text":"message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet "},{"id":"raw9","role":"user","contentType":"text","text":"message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet "},{"id":"raw10","role":"assistant","contentType":"text","text":"message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet "},{"id":"raw11","role":"user","contentType":"text","text":"message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet "},{"id":"raw12","role":"assistant","contentType":"text","text":"message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet "},{"id":"raw13","role":"user","contentType":"text","text":"message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet "},{"id":"raw14","role":"assistant","contentType":"text","text":"message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet "},{"id":"raw15","role":"user","contentType":"text","text":"message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet "},{"id":"raw16","role":"assistant","contentType":"text","text":"message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet "},{"id":"raw17","role":"user","contentType":"text","text":"message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet "},{"id":"raw18","role":"assistant","contentType":"text","text":"message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet "},{"id":"raw19","role":"user","contentType":"text","text":"message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet "},{"id":"raw20","role":"assistant","contentType":"text","text":"message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet "},{"id":"raw21","role":"user","contentType":"text","text":"message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet "},{"id":"raw22","role":"assistant","contentType":"text","text":"message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet "},{"id":"raw23","role":"user","contentType":"text","text":"message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet "},{"id":"raw24","role":"assistant","contentType":"text","text":"message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet "},{"id":"raw25","role":"user","contentType":"text","text":"message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet "},{"id":"raw26","role":"assistant","contentType":"text","text":"message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet "},{"id":"raw27","role":"user","contentType":"text","text":"message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet "},{"id":"raw28","role":"assistant","contentType":"text","text":"message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet "},{"id":"raw29","role":"user","contentType":"text","text":"message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet "},{"id":"raw30","role":"assistant","contentType":"text","text":"message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet "}],"metadata":{"corpus":"corpus-fork-retained","publicSnapshotRetained":true,"publicSnapshotStoredRefs":[],"biliVersion":"0.1.191"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"directBlockIds":[],"compressedTokens":1575,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":1575,"compressionCount":1,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2},"blockContents":{"b1":{"one":null,"full":{"text":"retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-fork-retained","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-fork-retained","meta":{"protocol":"chat","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-fork-retained","title":"Corpus corpus-fork-retained"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3},"pluginSnapshot":[{"id":"raw1","role":"user","contentType":"text","text":"message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet message body raw1 lorem ipsum dolor sit amet "},{"id":"raw2","role":"assistant","contentType":"text","text":"message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet message body raw2 lorem ipsum dolor sit amet "},{"id":"raw3","role":"user","contentType":"text","text":"message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet message body raw3 lorem ipsum dolor sit amet "},{"id":"raw4","role":"assistant","contentType":"text","text":"message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet message body raw4 lorem ipsum dolor sit amet "},{"id":"raw5","role":"user","contentType":"text","text":"message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet message body raw5 lorem ipsum dolor sit amet "},{"id":"raw6","role":"assistant","contentType":"text","text":"message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet message body raw6 lorem ipsum dolor sit amet "},{"id":"raw7","role":"user","contentType":"text","text":"message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet message body raw7 lorem ipsum dolor sit amet "},{"id":"raw8","role":"assistant","contentType":"text","text":"message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet message body raw8 lorem ipsum dolor sit amet "},{"id":"raw9","role":"user","contentType":"text","text":"message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet message body raw9 lorem ipsum dolor sit amet "},{"id":"raw10","role":"assistant","contentType":"text","text":"message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet message body raw10 lorem ipsum dolor sit amet "},{"id":"raw11","role":"user","contentType":"text","text":"message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet message body raw11 lorem ipsum dolor sit amet "},{"id":"raw12","role":"assistant","contentType":"text","text":"message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet message body raw12 lorem ipsum dolor sit amet "},{"id":"raw13","role":"user","contentType":"text","text":"message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet message body raw13 lorem ipsum dolor sit amet "},{"id":"raw14","role":"assistant","contentType":"text","text":"message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet "},{"id":"raw15","role":"user","contentType":"text","text":"message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet "},{"id":"raw16","role":"assistant","contentType":"text","text":"message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet "},{"id":"raw17","role":"user","contentType":"text","text":"message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet "},{"id":"raw18","role":"assistant","contentType":"text","text":"message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet "},{"id":"raw19","role":"user","contentType":"text","text":"message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet "},{"id":"raw20","role":"assistant","contentType":"text","text":"message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet "},{"id":"raw21","role":"user","contentType":"text","text":"message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet message body raw21 lorem ipsum dolor sit amet "},{"id":"raw22","role":"assistant","contentType":"text","text":"message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet message body raw22 lorem ipsum dolor sit amet "},{"id":"raw23","role":"user","contentType":"text","text":"message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet message body raw23 lorem ipsum dolor sit amet "},{"id":"raw24","role":"assistant","contentType":"text","text":"message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet message body raw24 lorem ipsum dolor sit amet "},{"id":"raw25","role":"user","contentType":"text","text":"message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet message body raw25 lorem ipsum dolor sit amet "},{"id":"raw26","role":"assistant","contentType":"text","text":"message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet message body raw26 lorem ipsum dolor sit amet "},{"id":"raw27","role":"user","contentType":"text","text":"message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet message body raw27 lorem ipsum dolor sit amet "},{"id":"raw28","role":"assistant","contentType":"text","text":"message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet message body raw28 lorem ipsum dolor sit amet "},{"id":"raw29","role":"user","contentType":"text","text":"message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet message body raw29 lorem ipsum dolor sit amet "},{"id":"raw30","role":"assistant","contentType":"text","text":"message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet message body raw30 lorem ipsum dolor sit amet "}],"metadata":{"corpus":"corpus-fork-retained","publicSnapshotRetained":true,"publicSnapshotStoredRefs":[],"biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8"],"directBlockIds":[],"compressedTokens":1575,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00002","endRef":"m00020"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":1575,"compressionCount":1,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":2,"nextRunId":2},"blockContents":{"b1":{"one":null,"full":{"text":"retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 retained fixture fold over raw2..raw20 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/image/anthropic/127.0.0.1_b139318d5755710735cbf443.json b/tests/golden/storage-corpus/image/anthropic/127.0.0.1_b139318d5755710735cbf443.json index 9ac565c53f..f5be50a83f 100644 --- a/tests/golden/storage-corpus/image/anthropic/127.0.0.1_b139318d5755710735cbf443.json +++ b/tests/golden/storage-corpus/image/anthropic/127.0.0.1_b139318d5755710735cbf443.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-image","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-image","meta":{"protocol":"anthropic","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-image","title":"Corpus corpus-image"},"stats":{"requests":3,"tokensSaved":0,"inputTokens":99000,"cachedTokens":1000,"outputTokens":500,"cacheSamples":3,"lastInputTokens":99000,"contextTokens":99000,"contextTokensSource":"estimate","imageShrunkCount":1,"imageBytesSaved":4096,"imageTokensSaved":1024,"imageFullCalls":1,"imageFullRestores":1},"messages":[{"id":"raw14","role":"assistant","contentType":"text","text":"message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet "},{"id":"raw15","role":"user","contentType":"text","text":"message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet "},{"id":"raw16","role":"assistant","contentType":"text","text":"message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet "},{"id":"raw17","role":"user","contentType":"text","text":"message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet "},{"id":"raw18","role":"assistant","contentType":"text","text":"message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet "},{"id":"raw19","role":"user","contentType":"text","text":"message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet "},{"id":"raw20","role":"assistant","contentType":"text","text":"message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet "},{"id":"rawimg1","role":"user","contentType":"image","text":"look at this","media":"aGVsbG8gaW1hZ2UgY29ycHVz"}],"messagesFolded":true,"metadata":{"corpus":"corpus-image","imageShrinks":[{"ref":"m00021","from":8192,"to":4096}],"biliVersion":"0.1.191"},"state":{"blocks":[],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","rawimg1":"m00021"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"rawimg1"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":0,"compressionCount":0,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"imageFullRestored":[],"imageShrinks":[],"nextBlockId":1,"nextRunId":1},"blockContents":{},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-image","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-image","meta":{"protocol":"anthropic","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-image","title":"Corpus corpus-image"},"stats":{"requests":3,"tokensSaved":0,"inputTokens":99000,"cachedTokens":1000,"outputTokens":500,"cacheSamples":3,"lastInputTokens":99000,"contextTokens":99000,"contextTokensSource":"estimate","imageShrunkCount":1,"imageBytesSaved":4096,"imageTokensSaved":1024,"imageFullCalls":1,"imageFullRestores":1},"messages":[{"id":"raw14","role":"assistant","contentType":"text","text":"message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet message body raw14 lorem ipsum dolor sit amet "},{"id":"raw15","role":"user","contentType":"text","text":"message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet message body raw15 lorem ipsum dolor sit amet "},{"id":"raw16","role":"assistant","contentType":"text","text":"message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet message body raw16 lorem ipsum dolor sit amet "},{"id":"raw17","role":"user","contentType":"text","text":"message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet message body raw17 lorem ipsum dolor sit amet "},{"id":"raw18","role":"assistant","contentType":"text","text":"message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet message body raw18 lorem ipsum dolor sit amet "},{"id":"raw19","role":"user","contentType":"text","text":"message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet message body raw19 lorem ipsum dolor sit amet "},{"id":"raw20","role":"assistant","contentType":"text","text":"message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet message body raw20 lorem ipsum dolor sit amet "},{"id":"rawimg1","role":"user","contentType":"image","text":"look at this","media":"aGVsbG8gaW1hZ2UgY29ycHVz"}],"messagesFolded":true,"metadata":{"corpus":"corpus-image","biliVersion":"0.1.197","storageMode":"legacy","imageShrinks":[{"ref":"m00021","from":8192,"to":4096}]},"state":{"blocks":[],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","rawimg1":"m00021"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"rawimg1"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":0,"compressionCount":0,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"nextBlockId":1,"nextRunId":1,"imageFullRestored":[],"imageShrinks":[]},"blockContents":{},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/manifest.json b/tests/golden/storage-corpus/manifest.json index 4477d3a770..bb9d16aaf7 100644 --- a/tests/golden/storage-corpus/manifest.json +++ b/tests/golden/storage-corpus/manifest.json @@ -4,14 +4,14 @@ "files": [ "anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json" ], - "digest": "122b2bee0fd7917d225c8ada34cd61e860fc7c077b6f0fb035c11395e5b1f1a1" + "digest": "8485c8f69693cca987ec3c612bdc31fe429e70fe0fade5e05b9db936f0418311" }, "tier2": { "description": "superseded T1 + active T2, distinct `one` views, byte-identical pair pins #401 normalize-on-load", "files": [ "chat/127.0.0.1_8453ec7a56646bc014ac0d88.json" ], - "digest": "460f9ed471e46c7bf4923182b58a8fe0daa038aafae7dbc515f6d5c826117131", + "digest": "0cfdba77bc1a052c0c3b8170874c4d963273b6580c822c6c9a5ee8f0f3d09b43", "notes": { "t2Block": "b3" } @@ -21,7 +21,7 @@ "files": [ "anthropic/127.0.0.1_e17d4db40407d10867daeb1d.json" ], - "digest": "c29c76cdfa77e75897f78478ace6acc25429b39fb6c591953e9a3405324383b8", + "digest": "de057f87e0737222362d44326ec9e139457d50d67566ffaf5a7bb590b549c12d", "notes": { "ghostRef": "m00010" } @@ -31,24 +31,24 @@ "files": [ "chat/127.0.0.1_bde31987d03ca1ebaeb96ba0.json" ], - "digest": "0784a7fdb054dcf08ac715071252877d4397bceb00eafa696ecfcc98ff89ba96" + "digest": "edf7ac9a0cb912acc39b17667dfd1245a24b6bf6f01b57f510f782258e3e3bcb" }, "fork-retained": { "description": "publicSnapshotRetained only — pluginSnapshot persisted, forkContentStore DROPPED (pins the #2675 ② asymmetry verbatim)", "files": [ "chat/127.0.0.1_dec59ddccc0b4b89ff346c9b.json" ], - "digest": "29fd3634a8cace83d547aa3f5645daf895c9e20d35dc65c2ebf7e2bb9fdf06e2", + "digest": "63328d62ba50899927adda2154185ec83b9071ca8a84611dec1c57d5d4a51a8e", "notes": { "expectContentStoreOnLoad": "absent" } }, "image": { - "description": "base64 image message + image stats + imageShrinks metadata", + "description": "base64 image message with pre-#3266 legacy image keys on disk (dropped on load)", "files": [ "anthropic/127.0.0.1_b139318d5755710735cbf443.json" ], - "digest": "56c57f85165d169ec97be6ed69169294247a544e8cabdb1dd74ef928486a977e" + "digest": "deec17f777d11294316b2250160b0577756b2e686ed0f2f1a6441ed06a581dc2" }, "ccr": { "description": "content-store.json sibling with two CCR originals (#1097 envelope)", @@ -56,7 +56,7 @@ "responses/127.0.0.1_0787df32f3cf98f922f7c0f0.content-store.json", "responses/127.0.0.1_0787df32f3cf98f922f7c0f0.json" ], - "digest": "73e5d4039fedabdcee21abe9015ab9a067ae1353379cca9e4c1778e7fc117902" + "digest": "2d15c631cf8ee6fd406fb4354db508bed86f11ecaefcb7c9b07c48ab3a7493d8" }, "twinfile": { "description": "namespaced v2 record + stale FLAT v1 twin for the same id (#2671 ① twin-namespace)", @@ -64,11 +64,11 @@ "6fe5d8f2afee3e83e5360fa8.json", "openai/127.0.0.1_6fe5d8f2afee3e83e5360fa8.json" ], - "digest": "54d07a10dc599fe9f024f67385f989e055bde971cca4ab2d838135c791c3da71", + "digest": "fe94b9453f3e7e2b57831965fbf87ff2604efdd11e74ecec612cbefd82e0e122", "notes": { "flatTwinRequests": 1, "namespacedRequests": 42, - "flatFallbackDigest": "ee43014d1c9a1ae3539c72b23ea884eb65aa42104cd36975b98a7f9e28540463", + "flatFallbackDigest": "73ae30ed8e603bd51978f2d891acb6aada8c4769e05acbbfdd2a64d4e1f89e57", "flatFallbackRequests": 1 } }, @@ -77,6 +77,6 @@ "files": [ "anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json" ], - "digest": "122b2bee0fd7917d225c8ada34cd61e860fc7c077b6f0fb035c11395e5b1f1a1" + "digest": "8485c8f69693cca987ec3c612bdc31fe429e70fe0fade5e05b9db936f0418311" } } diff --git a/tests/golden/storage-corpus/tier2/chat/127.0.0.1_8453ec7a56646bc014ac0d88.json b/tests/golden/storage-corpus/tier2/chat/127.0.0.1_8453ec7a56646bc014ac0d88.json index f61a0c6d45..d1f338757f 100644 --- a/tests/golden/storage-corpus/tier2/chat/127.0.0.1_8453ec7a56646bc014ac0d88.json +++ b/tests/golden/storage-corpus/tier2/chat/127.0.0.1_8453ec7a56646bc014ac0d88.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-tier2","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-tier2","meta":{"protocol":"chat","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-tier2","title":"Corpus corpus-tier2"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3,"imageShrunkCount":0,"imageBytesSaved":0,"imageTokensSaved":0},"messages":[{"id":"acp_summary_b2","role":"system","contentType":"text","text":"[Compressed conversation section]\ntier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block"},{"id":"acp_summary_b3","role":"system","contentType":"text","text":"[Compressed conversation section]\ntier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block"},{"id":"raw55","role":"user","contentType":"text","text":"message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet "},{"id":"raw56","role":"assistant","contentType":"text","text":"message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet "},{"id":"raw57","role":"user","contentType":"text","text":"message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet "},{"id":"raw58","role":"assistant","contentType":"text","text":"message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet "},{"id":"raw59","role":"user","contentType":"text","text":"message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet "},{"id":"raw60","role":"assistant","contentType":"text","text":"message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet "}],"messagesFolded":true,"metadata":{"corpus":"corpus-tier2","biliVersion":"0.1.191"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18","raw19","raw20"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18","raw19","raw20"],"directBlockIds":[],"compressedTokens":4330,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":false,"startRef":"m00002","endRef":"m00020"},{"blockId":"b2","runId":"r2","tier":1,"summary":"tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block ","directMessageIds":["raw21","raw22","raw23","raw24","raw25","raw26","raw27","raw28","raw29","raw30","raw31","raw32","raw33","raw34","raw35","raw36","raw37","raw38"],"effectiveMessageIds":["raw21","raw22","raw23","raw24","raw25","raw26","raw27","raw28","raw29","raw30","raw31","raw32","raw33","raw34","raw35","raw36","raw37","raw38"],"directBlockIds":[],"compressedTokens":4140,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00021","endRef":"m00040"},{"blockId":"b3","runId":"r3","tier":2,"summary":"tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block ","directMessageIds":[],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18","raw19","raw20"],"directBlockIds":["b1"],"compressedTokens":88,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"b1","endRef":"b1"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030","raw31":"m00031","raw32":"m00032","raw33":"m00033","raw34":"m00034","raw35":"m00035","raw36":"m00036","raw37":"m00037","raw38":"m00038","raw39":"m00039","raw40":"m00040","raw41":"m00041","raw42":"m00042","raw43":"m00043","raw44":"m00044","raw45":"m00045","raw46":"m00046","raw47":"m00047","raw48":"m00048","raw49":"m00049","raw50":"m00050","raw51":"m00051","raw52":"m00052","raw53":"m00053","raw54":"m00054","raw55":"m00055","raw56":"m00056","raw57":"m00057","raw58":"m00058","raw59":"m00059","raw60":"m00060"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30","m00031":"raw31","m00032":"raw32","m00033":"raw33","m00034":"raw34","m00035":"raw35","m00036":"raw36","m00037":"raw37","m00038":"raw38","m00039":"raw39","m00040":"raw40","m00041":"raw41","m00042":"raw42","m00043":"raw43","m00044":"raw44","m00045":"raw45","m00046":"raw46","m00047":"raw47","m00048":"raw48","m00049":"raw49","m00050":"raw50","m00051":"raw51","m00052":"raw52","m00053":"raw53","m00054":"raw54","m00055":"raw55","m00056":"raw56","m00057":"raw57","m00058":"raw58","m00059":"raw59","m00060":"raw60"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":8558,"compressionCount":3,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":4,"nextRunId":4},"blockContents":{"b1":{"one":{"text":"tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block ","count":19},"full":{"text":"tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block ","count":19}},"b2":{"one":{"text":"one-line b2 view","count":1},"full":{"text":"summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 ","count":18}},"b3":{"one":{"text":"one-line b3 view","count":1},"full":{"text":"summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-tier2","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-tier2","meta":{"protocol":"chat","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-tier2","title":"Corpus corpus-tier2"},"stats":{"requests":7,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3},"messages":[{"id":"raw55","role":"user","contentType":"text","text":"message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet message body raw55 lorem ipsum dolor sit amet "},{"id":"raw56","role":"assistant","contentType":"text","text":"message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet message body raw56 lorem ipsum dolor sit amet "},{"id":"raw57","role":"user","contentType":"text","text":"message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet message body raw57 lorem ipsum dolor sit amet "},{"id":"raw58","role":"assistant","contentType":"text","text":"message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet message body raw58 lorem ipsum dolor sit amet "},{"id":"raw59","role":"user","contentType":"text","text":"message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet message body raw59 lorem ipsum dolor sit amet "},{"id":"raw60","role":"assistant","contentType":"text","text":"message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet message body raw60 lorem ipsum dolor sit amet "},{"id":"acp_summary_b2","role":"system","contentType":"text","text":"[Compressed conversation section]\ntier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block"},{"id":"acp_summary_b3","role":"system","contentType":"text","text":"[Compressed conversation section]\ntier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block"}],"messagesFolded":true,"metadata":{"corpus":"corpus-tier2","biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[{"blockId":"b1","runId":"r1","tier":1,"summary":"tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block ","directMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18","raw19","raw20"],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18","raw19","raw20"],"directBlockIds":[],"compressedTokens":4330,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":false,"startRef":"m00002","endRef":"m00020"},{"blockId":"b2","runId":"r2","tier":1,"summary":"tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block tier1 summary text for the second block ","directMessageIds":["raw21","raw22","raw23","raw24","raw25","raw26","raw27","raw28","raw29","raw30","raw31","raw32","raw33","raw34","raw35","raw36","raw37","raw38"],"effectiveMessageIds":["raw21","raw22","raw23","raw24","raw25","raw26","raw27","raw28","raw29","raw30","raw31","raw32","raw33","raw34","raw35","raw36","raw37","raw38"],"directBlockIds":[],"compressedTokens":4140,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"m00021","endRef":"m00040"},{"blockId":"b3","runId":"r3","tier":2,"summary":"tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block tier-2 distillation replacing the first block ","directMessageIds":[],"effectiveMessageIds":["raw2","raw3","raw4","raw5","raw6","raw7","raw8","raw9","raw10","raw11","raw12","raw13","raw14","raw15","raw16","raw17","raw18","raw19","raw20"],"directBlockIds":["b1"],"compressedTokens":88,"createdAt":1700000000001,"survivedCount":0,"generation":"young","active":true,"startRef":"b1","endRef":"b1"}],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016","raw17":"m00017","raw18":"m00018","raw19":"m00019","raw20":"m00020","raw21":"m00021","raw22":"m00022","raw23":"m00023","raw24":"m00024","raw25":"m00025","raw26":"m00026","raw27":"m00027","raw28":"m00028","raw29":"m00029","raw30":"m00030","raw31":"m00031","raw32":"m00032","raw33":"m00033","raw34":"m00034","raw35":"m00035","raw36":"m00036","raw37":"m00037","raw38":"m00038","raw39":"m00039","raw40":"m00040","raw41":"m00041","raw42":"m00042","raw43":"m00043","raw44":"m00044","raw45":"m00045","raw46":"m00046","raw47":"m00047","raw48":"m00048","raw49":"m00049","raw50":"m00050","raw51":"m00051","raw52":"m00052","raw53":"m00053","raw54":"m00054","raw55":"m00055","raw56":"m00056","raw57":"m00057","raw58":"m00058","raw59":"m00059","raw60":"m00060"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16","m00017":"raw17","m00018":"raw18","m00019":"raw19","m00020":"raw20","m00021":"raw21","m00022":"raw22","m00023":"raw23","m00024":"raw24","m00025":"raw25","m00026":"raw26","m00027":"raw27","m00028":"raw28","m00029":"raw29","m00030":"raw30","m00031":"raw31","m00032":"raw32","m00033":"raw33","m00034":"raw34","m00035":"raw35","m00036":"raw36","m00037":"raw37","m00038":"raw38","m00039":"raw39","m00040":"raw40","m00041":"raw41","m00042":"raw42","m00043":"raw43","m00044":"raw44","m00045":"raw45","m00046":"raw46","m00047":"raw47","m00048":"raw48","m00049":"raw49","m00050":"raw50","m00051":"raw51","m00052":"raw52","m00053":"raw53","m00054":"raw54","m00055":"raw55","m00056":"raw56","m00057":"raw57","m00058":"raw58","m00059":"raw59","m00060":"raw60"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":8558,"compressionCount":3,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"terminalStreak":0,"nextBlockId":4,"nextRunId":4},"blockContents":{"b1":{"one":{"text":"tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block ","count":19},"full":{"text":"tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block tier1 summary text for the superseded block ","count":19}},"b2":{"one":{"text":"one-line b2 view","count":1},"full":{"text":"summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 summary b2 ","count":18}},"b3":{"one":{"text":"one-line b3 view","count":1},"full":{"text":"summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 summary b3 ","count":19}}},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/twinfile/openai/127.0.0.1_6fe5d8f2afee3e83e5360fa8.json b/tests/golden/storage-corpus/twinfile/openai/127.0.0.1_6fe5d8f2afee3e83e5360fa8.json index 6473612b66..89b4a236de 100644 --- a/tests/golden/storage-corpus/twinfile/openai/127.0.0.1_6fe5d8f2afee3e83e5360fa8.json +++ b/tests/golden/storage-corpus/twinfile/openai/127.0.0.1_6fe5d8f2afee3e83e5360fa8.json @@ -1 +1 @@ -{"version":3,"savedAt":1700000000001,"id":"corpus-twin","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-twin","meta":{"protocol":"openai","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-twin","title":"Corpus corpus-twin"},"stats":{"requests":42,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3,"imageShrunkCount":0,"imageBytesSaved":0,"imageTokensSaved":0},"metadata":{"corpus":"corpus-twin","biliVersion":"0.1.191"},"state":{"blocks":[],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":0,"compressionCount":0,"absorbedTokens":0,"imagesShrunk":0,"imageBytesSaved":0,"imageTokensSaved":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"imageFullRestored":[],"imageShrinks":[],"nextBlockId":1,"nextRunId":1},"blockContents":{},"createdAt":1700000000000}} \ No newline at end of file +{"version":3,"savedAt":1700000000001,"id":"corpus-twin","payload":{"version":3,"savedAt":1700000000001,"id":"corpus-twin","meta":{"protocol":"openai","upstreamOrigin":"http://127.0.0.1:8199","label":"corpus-corpus-twin","title":"Corpus corpus-twin"},"stats":{"requests":42,"tokensSaved":12345,"inputTokens":234567,"cachedTokens":123456,"outputTokens":3456,"cacheSamples":7,"lastInputTokens":45678,"contextTokens":45678,"contextTokensSource":"usage","localInputEstimate":45000,"lastUsageGradeTokens":44000,"lastInputTokensOrigin":"http://127.0.0.1:8199","retrieveCalls":3,"retrieveHits":2,"retrieveMisses":1,"retrieveDelivered":3},"metadata":{"corpus":"corpus-twin","biliVersion":"0.1.197","storageMode":"legacy"},"state":{"blocks":[],"messageRefs":{"byRaw":{"raw1":"m00001","raw2":"m00002","raw3":"m00003","raw4":"m00004","raw5":"m00005","raw6":"m00006","raw7":"m00007","raw8":"m00008","raw9":"m00009","raw10":"m00010","raw11":"m00011","raw12":"m00012","raw13":"m00013","raw14":"m00014","raw15":"m00015","raw16":"m00016"},"byRef":{"m00001":"raw1","m00002":"raw2","m00003":"raw3","m00004":"raw4","m00005":"raw5","m00006":"raw6","m00007":"raw7","m00008":"raw8","m00009":"raw9","m00010":"raw10","m00011":"raw11","m00012":"raw12","m00013":"raw13","m00014":"raw14","m00015":"raw15","m00016":"raw16"}},"tokenSnapshot":{},"nudge":{"lastPerMessageNudgeTokens":0,"lastNudgeShownTokens":0,"baselineTokens":0,"anchors":{},"lastShownByTier":{}},"stats":{"tokensCompressed":0,"compressionCount":0,"absorbedTokens":0,"storedCount":0,"retrievalCount":0},"absorbed":[],"rules":[],"nextRuleId":1,"nextBlockId":1,"nextRunId":1},"blockContents":{},"createdAt":1700000000000}} \ No newline at end of file diff --git a/tests/golden/storage-corpus/zstd/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json b/tests/golden/storage-corpus/zstd/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json index b6f066a942..c41dc2442b 100644 Binary files a/tests/golden/storage-corpus/zstd/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json and b/tests/golden/storage-corpus/zstd/anthropic/127.0.0.1_29e4587af02d1ed9ae4b0054.json differ diff --git a/tests/golden/storage-render/anthropic.json b/tests/golden/storage-render/anthropic.json index 266b8df34e..9235a12c5b 100644 --- a/tests/golden/storage-render/anthropic.json +++ b/tests/golden/storage-render/anthropic.json @@ -80,12 +80,12 @@ "foldAt": 9, "editedAt": 12, "summaryFrom": 9, - "stateDigest": "96fe7ed64ee5067a41c42c88989f56ce4e77542423f5700b5c1bbf46450009f0", + "stateDigest": "4902c51f20262600230b2999242a418eaf748efee239154e8fb53617985b7d14", "sectionDigests": { - "state": "5db7a736df3a3e5b", + "state": "db2dcb8f50f59a6f", "blockContents": "dc7d13d250c94bb4", - "stats": "d296e6929cff0970", - "metadata": "47410ac26797409c" + "stats": "148538077b9c86e2", + "metadata": "88215dac08f1ce62" }, "stateKeyDigests": { "blocks": "1cbe172309e4490d", @@ -101,9 +101,7 @@ "terminalStreak": "5feceb66ffc86f38", "nextRuleId": "6b86b273ff34fce1", "absorbed": "4f53cda18c2baa0c", - "rules": "4f53cda18c2baa0c", - "imageFullRestored": "4f53cda18c2baa0c", - "imageShrinks": "4f53cda18c2baa0c" + "rules": "4f53cda18c2baa0c" }, "stateShape": { "refs": 49, diff --git a/tests/golden/storage-render/chat.json b/tests/golden/storage-render/chat.json index e94243e68c..be56763953 100644 --- a/tests/golden/storage-render/chat.json +++ b/tests/golden/storage-render/chat.json @@ -80,12 +80,12 @@ "foldAt": 9, "editedAt": 12, "summaryFrom": 9, - "stateDigest": "169b3f2c63f523bf93b5409941adaa7e8eee43745ff855e560ce32395f417f75", + "stateDigest": "30179062ca29d82e096c7cfef74acf2aaab007c707954f98c83c125c56694641", "sectionDigests": { - "state": "bba2f434570acbd2", + "state": "5db50ed9b7e6c9c5", "blockContents": "94a58f96d7c5cfc3", - "stats": "0387e0a7f852af4e", - "metadata": "e668bd93e7435b67" + "stats": "06757c83f90796fd", + "metadata": "e3e0f2cc27086e0b" }, "stateKeyDigests": { "blocks": "9aa73e5fb9f93d6c", @@ -101,9 +101,7 @@ "terminalStreak": "5feceb66ffc86f38", "nextRuleId": "6b86b273ff34fce1", "absorbed": "4f53cda18c2baa0c", - "rules": "4f53cda18c2baa0c", - "imageFullRestored": "4f53cda18c2baa0c", - "imageShrinks": "4f53cda18c2baa0c" + "rules": "4f53cda18c2baa0c" }, "stateShape": { "refs": 42, diff --git a/tests/golden/storage-render/google.json b/tests/golden/storage-render/google.json index 0637a6cb99..2d71b43372 100644 --- a/tests/golden/storage-render/google.json +++ b/tests/golden/storage-render/google.json @@ -80,12 +80,12 @@ "foldAt": 9, "editedAt": 12, "summaryFrom": 9, - "stateDigest": "84d8e87180c4cf4dd9cc2e26234b62cb6a504b1c4dd4f3c73797c7286a4476ab", + "stateDigest": "d786bbc73be74afd81813ad24275b401b6e4de206fed15ae996cfa3333906e28", "sectionDigests": { - "state": "6d2f312d7bc924d7", + "state": "4db177f49e9bb5e2", "blockContents": "473264d9df8ba338", - "stats": "5702a6493cdfe768", - "metadata": "44253c0faed160f9" + "stats": "46b1938d50fd6a58", + "metadata": "e58a57fe06b719ef" }, "stateKeyDigests": { "blocks": "8e14f0879bf7ebd7", @@ -101,9 +101,7 @@ "terminalStreak": "5feceb66ffc86f38", "nextRuleId": "6b86b273ff34fce1", "absorbed": "4f53cda18c2baa0c", - "rules": "4f53cda18c2baa0c", - "imageFullRestored": "4f53cda18c2baa0c", - "imageShrinks": "4f53cda18c2baa0c" + "rules": "4f53cda18c2baa0c" }, "stateShape": { "refs": 42, diff --git a/tests/golden/storage-render/responses.json b/tests/golden/storage-render/responses.json index a4d9833212..b77a246c03 100644 --- a/tests/golden/storage-render/responses.json +++ b/tests/golden/storage-render/responses.json @@ -80,12 +80,12 @@ "foldAt": 9, "editedAt": 12, "summaryFrom": 9, - "stateDigest": "13dfa2fc327ec2c292b20f373c10da4abc2712509103640f2227427d5f54db42", + "stateDigest": "4cc8b08e4448e1f0f876d4598f124efdb0406fa485ab430a8ab334f6502d1c8d", "sectionDigests": { - "state": "07823f2d3271c52a", + "state": "87c9f1a270dc9484", "blockContents": "8460729b2654a816", - "stats": "c21b1ef672b5274c", - "metadata": "9cd94af0e95aaafe" + "stats": "01b8752be2f61fb9", + "metadata": "ea6c2c7a998723f3" }, "stateKeyDigests": { "blocks": "7fff1dfb54a617cf", @@ -101,9 +101,7 @@ "terminalStreak": "5feceb66ffc86f38", "nextRuleId": "6b86b273ff34fce1", "absorbed": "4f53cda18c2baa0c", - "rules": "4f53cda18c2baa0c", - "imageFullRestored": "4f53cda18c2baa0c", - "imageShrinks": "4f53cda18c2baa0c" + "rules": "4f53cda18c2baa0c" }, "stateShape": { "refs": 55, diff --git a/tests/golden/wire-contract/bili.json b/tests/golden/wire-contract/bili.json index 75cd0bba72..95b5629723 100644 --- a/tests/golden/wire-contract/bili.json +++ b/tests/golden/wire-contract/bili.json @@ -1236,22 +1236,6 @@ ] } } - }, - "imageFullGoogle": { - "name": "image_full", - "description": "Restore original-resolution images for a previously downscaled message. Call when you cannot read details (text, colors, alignment) in a reduced image: pass the message ref (\"mNNNNN\") from the [Downscaled screenshots] note. Full resolution applies for the rest of this session.", - "parameters": { - "type": "object", - "properties": { - "ref": { - "type": "string", - "description": "mNNNNN ref of the message whose image(s) should be restored to full resolution" - } - }, - "required": [ - "ref" - ] - } } } } diff --git a/tests/golden/wire-contract/kernel.json b/tests/golden/wire-contract/kernel.json index 75fb2593c3..4d746ccd8d 100644 --- a/tests/golden/wire-contract/kernel.json +++ b/tests/golden/wire-contract/kernel.json @@ -1509,58 +1509,6 @@ ] } }, - "IMAGE_FULL_TOOL": { - "name": "image_full", - "description": "Restore original-resolution images for a previously downscaled message. Call when you cannot read details (text, colors, alignment) in a reduced image: pass the message ref (\"mNNNNN\") from the [Downscaled screenshots] note. Full resolution applies for the rest of this session.", - "input_schema": { - "type": "object", - "properties": { - "ref": { - "type": "string", - "description": "mNNNNN ref of the message whose image(s) should be restored to full resolution" - } - }, - "required": [ - "ref" - ] - } - }, - "IMAGE_FULL_TOOL_OPENAI": { - "type": "function", - "function": { - "name": "image_full", - "description": "Restore original-resolution images for a previously downscaled message. Call when you cannot read details (text, colors, alignment) in a reduced image: pass the message ref (\"mNNNNN\") from the [Downscaled screenshots] note. Full resolution applies for the rest of this session.", - "parameters": { - "type": "object", - "properties": { - "ref": { - "type": "string", - "description": "mNNNNN ref of the message whose image(s) should be restored to full resolution" - } - }, - "required": [ - "ref" - ] - } - } - }, - "IMAGE_FULL_TOOL_RESPONSES": { - "type": "function", - "name": "image_full", - "description": "Restore original-resolution images for a previously downscaled message. Call when you cannot read details (text, colors, alignment) in a reduced image: pass the message ref (\"mNNNNN\") from the [Downscaled screenshots] note. Full resolution applies for the rest of this session.", - "parameters": { - "type": "object", - "properties": { - "ref": { - "type": "string", - "description": "mNNNNN ref of the message whose image(s) should be restored to full resolution" - } - }, - "required": [ - "ref" - ] - } - }, "RETRIEVE_TOOL": { "name": "acp_retrieve", "description": "Retrieve the full original text of a stored tool result. REQUIRED when you need details from a placeholder that starts with 📦 [acp-stored #mNNNNN: pass its ref. Returns the exact original text; the placeholder stays in context. Unknown refs return not-found.", @@ -1661,13 +1609,6 @@ "enabled": false, "minReduction": 0.1 }, - "imageCompression": { - "enabled": false, - "minTokens": 512, - "maxDimension": 1280, - "quality": 80, - "format": "webp" - }, "ccr": { "enabled": false, "toolName": "acp_retrieve", @@ -1691,8 +1632,7 @@ "ACP_CACHE_TOOL_NAME": "acp_cache", "ABSORB_TOOL_NAME": "absorb", "RETRIEVE_TOOL_NAME": "acp_retrieve", - "RULE_TOOL_NAME": "acp_rule", - "IMAGE_FULL_TOOL_NAME": "image_full" + "RULE_TOOL_NAME": "acp_rule" }, "markers": { "ACP_TEXT_OPEN": "", diff --git a/tests/image-compress.test.ts b/tests/image-compress.test.ts deleted file mode 100644 index 7620cc2f30..0000000000 --- a/tests/image-compress.test.ts +++ /dev/null @@ -1,397 +0,0 @@ -import test from "node:test"; -import assert from "node:assert/strict"; -import { mkdtempSync } from "node:fs"; -import { tmpdir } from "node:os"; -import path from "node:path"; -import { rmrf } from "./tmp-rm.ts"; - -process.env.BILI_PERSIST = "0"; - -import sharp from "sharp"; -import { - DEFAULT_IMAGE_COMPRESSION_CONFIG, - IMAGE_FULL_FAILURE_MARKER, - defaultConfig, - imageShrinksForRef, - isImageFullRestored, - type Config, -} from "acp-kernel"; -import type { BiliMessage } from "acp-kernel/wire"; -import { parseCompressSettings } from "../src/config.ts"; -import { applyCompressSettings, mergeCompress } from "../src/compress-settings.ts"; -import { isProxyToolFor } from "../src/absorb.ts"; -import { - IMAGE_FULL_TOOL_NAME, - applyImageCompressionPass, - executeImageFull, - imageFullTrailingNote, - imageUsageSuffix, - storeEffectiveImageCompression, -} from "../src/image-compress.ts"; -import { SessionStore, _setStoreForTest } from "../src/persist.ts"; -import { - _resetSessionsForTest, - getSession, - markDirty, - resetSessionCompression, - type Session, -} from "../src/session.ts"; - -interface Fixture { b64: string; mediaType: string; width: number; height: number; bytes: number } - -async function makeFixture(width: number, height: number, patterned: boolean): Promise { - const raw = Buffer.alloc(width * height * 3); - if (patterned) { - for (let i = 0; i < raw.length; i += 3) { - raw[i] = i & 0xff; - raw[i + 1] = (i * 7) & 0xff; - raw[i + 2] = (i * 13) & 0xff; - } - } else { - raw.fill(0x88); - } - const buf = await sharp(raw, { raw: { width, height, channels: 3 } }).png().toBuffer(); - return { b64: buf.toString("base64"), mediaType: "image/png", width, height, bytes: buf.length }; -} - -// 2048×2944: aspect 1.4375 ∈ [1.4, 2.6] and short side ≥ 720 ⇒ the kernel's -// heuristic classifier routes it downsample; the repeating pattern keeps the -// PNG large so the shrunken webp is guaranteed smaller (no keep-smaller flake). -// The size also sits at the kernel pixel-tile estimate cap (2125 tok), while -// the 1280-maxDimension recipe lands at ~1105 — so token savings are real, -// not just byte savings (the estimate is coarse and capped). -let shotCache: Fixture | undefined; -async function shot(): Promise { - return (shotCache ??= await makeFixture(2048, 2944, true)); -} -// 800×600 landscape ⇒ not screenshot-like ⇒ decision pass (byte-identical). -let flatCache: Fixture | undefined; -async function flat(): Promise { - return (flatCache ??= await makeFixture(800, 600, false)); -} - -function armedSession(byRaw: Record): Session { - const s = getSession(`img-${Math.random().toString(36).slice(2)}`); - storeEffectiveImageCompression(s, { enabled: true }); - // Seed BOTH ref maps: the kernel's image_full validation requires the ref - // to exist in byRef (in production processTurn/assignRefsNode fills both). - for (const [raw, ref] of Object.entries(byRaw)) { - s.state.messageRefs.byRaw[raw] = ref; - s.state.messageRefs.byRef[ref] = raw; - } - return s; -} - -function enabledCfg(extra: Record = {}): Config { - return applyCompressSettings(defaultConfig(200_000), 200_000, { imageCompression: { enabled: true, ...extra } }); -} - -interface AnthropicImgSource { type: string; media_type: string; data: string } -interface AnthropicImgBlock { type: string; source: AnthropicImgSource } - -function anthropicMsg(id: string, fx: Fixture): BiliMessage { - return { - id, - role: "user", - contentType: "text", - text: "", - rawAnthropicBlock: { type: "image", source: { type: "base64", media_type: fx.mediaType, data: fx.b64 } }, - }; -} - -function antSrc(m: BiliMessage): AnthropicImgSource { - return (m.rawAnthropicBlock as AnthropicImgBlock).source; -} - -const logsOf = (): { logs: string[]; log: (level: "info" | "warn" | "error", msg: string) => void } => { - const logs: string[] = []; - return { logs, log: (level, msg) => logs.push(`${level}|${msg}`) }; -}; - -test("parseCompressSettings validates imageCompression", () => { - const ok = parseCompressSettings({ - imageCompression: { enabled: true, minTokens: 512, maxDimension: 1280, quality: 80, format: "webp" }, - }); - assert.ok(ok); - assert.deepEqual(ok.imageCompression, { enabled: true, minTokens: 512, maxDimension: 1280, quality: 80, format: "webp" }); - assert.equal(parseCompressSettings({ imageCompression: { enabled: "yes" } }), undefined); - assert.equal(parseCompressSettings({ imageCompression: { minTokens: "500" } }), undefined); - assert.equal(parseCompressSettings({ imageCompression: { maxDimension: Number.NaN } }), undefined); - assert.equal(parseCompressSettings({ imageCompression: { quality: Number.NaN } }), undefined); - assert.equal(parseCompressSettings({ imageCompression: { format: "gif" } }), undefined); - assert.equal(parseCompressSettings({ imageCompression: [] }), undefined); -}); - -test("mergeCompress merges imageCompression sub-field-wise across levels", () => { - const out = mergeCompress( - { imageCompression: { enabled: true, minTokens: 100 } }, - undefined, - { imageCompression: { maxDimension: 900 } }, - ); - assert.deepEqual(out.imageCompression, { enabled: true, minTokens: 100, maxDimension: 900 }); -}); - -test("applyCompressSettings maps imageCompression onto the kernel config with defaults", () => { - const mapped = applyCompressSettings(defaultConfig(200_000), 200_000, { imageCompression: { enabled: true, minTokens: 200 } }); - assert.deepEqual(mapped.imageCompression, { ...DEFAULT_IMAGE_COMPRESSION_CONFIG, enabled: true, minTokens: 200 }); - // No level configures the feature ⇒ the kernel base default is inherited - // (enabled:false — the feature stays OFF unless explicitly enabled). - const absent = applyCompressSettings(defaultConfig(200_000), 200_000, {}); - assert.deepEqual(absent.imageCompression, DEFAULT_IMAGE_COMPRESSION_CONFIG); -}); - -test("unarmed session leaves traffic byte-identical", async () => { - const fx = await shot(); - const s = getSession(`img-off-${Math.random().toString(36).slice(2)}`); - s.state.messageRefs.byRaw.r1 = "m00001"; - const m = anthropicMsg("r1", fx); - const { logs, log } = logsOf(); - await applyImageCompressionPass(s, [m], { config: enabledCfg(), billing: "pixels", log }); - assert.equal(antSrc(m).data, fx.b64); - assert.equal(antSrc(m).media_type, "image/png"); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 0); - assert.equal(logs.length, 0); -}); - -test("decision pass-through: non-screenshot and below-min-tokens images untouched", async () => { - const f = await flat(); - const s = armedSession({ r1: "m00001", r2: "m00002" }); - const notScreenshot = anthropicMsg("r1", f); - // 720×1008 ≈ 936 pixel-tiles < minTokens 2000 ⇒ below-min-tokens pass. - const smallShot = await makeFixture(720, 1008, true); - const belowMin = anthropicMsg("r2", smallShot); - const { logs, log } = logsOf(); - await applyImageCompressionPass(s, [notScreenshot, belowMin], { config: enabledCfg({ minTokens: 2000 }), billing: "pixels", log }); - assert.equal(antSrc(notScreenshot).data, f.b64); - assert.equal(antSrc(belowMin).data, smallShot.b64); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 0); - assert.equal(imageShrinksForRef(s.state, "m00002").length, 0); - assert.equal(logs.length, 0); -}); - -test("anthropic screenshot shrunk once, deterministically, with record and stats", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const m = anthropicMsg("r1", fx); - const { logs, log } = logsOf(); - await applyImageCompressionPass(s, [m], { config: enabledCfg(), billing: "pixels", log }); - const src = antSrc(m); - assert.notEqual(src.data, fx.b64); - assert.equal(src.media_type, "image/webp"); - const meta = await sharp(Buffer.from(src.data, "base64")).metadata(); - assert.ok((meta.width ?? 0) > 0 && (meta.height ?? 0) > 0); - assert.ok(Math.max(meta.width ?? 0, meta.height ?? 0) <= 1280); - - const recs = imageShrinksForRef(s.state, "m00001"); - assert.equal(recs.length, 1); - assert.equal(recs[0].ref, "m00001"); - assert.equal(recs[0].format, "webp"); - assert.ok(recs[0].shrunkBytes < recs[0].originalBytes); - assert.ok(recs[0].tokensAfter < recs[0].tokensBefore); - assert.equal(s.stats.imageShrunkCount, 1); - assert.ok((s.stats.imageBytesSaved ?? 0) > 0); - assert.ok((s.stats.imageTokensSaved ?? 0) > 0); - assert.ok(logs.some((l) => l.includes("[acp-image]") && l.includes("m00001"))); - - // Second request carries the ORIGINAL bytes again (client never saw the - // shrunk form): fingerprint cache must emit byte-identical output without - // duplicating records or inflating stats. - const m2 = anthropicMsg("r1", fx); - await applyImageCompressionPass(s, [m2], { config: enabledCfg(), billing: "pixels" }); - assert.equal(antSrc(m2).data, src.data); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 1); - assert.equal(s.stats.imageShrunkCount, 1); - - // A message already carrying our emitted bytes must never be re-encoded - // (double-shrink would break the standing-wire-bytes invariant). - const before = antSrc(m).data; - await applyImageCompressionPass(s, [m], { config: enabledCfg(), billing: "pixels" }); - assert.equal(antSrc(m).data, before); -}); - -test("openai carriers: multi-part mixed routing, single data URL, mirror sync, remote URL untouched", async () => { - const sx = await shot(); - const fl = await flat(); - const s = armedSession({ r1: "m00001", r2: "m00002" }); - const dataUrl = (f: Fixture) => `data:${f.mediaType};base64,${f.b64}`; - - const multi: BiliMessage = { - id: "r1", - role: "user", - contentType: "text", - text: "", - rawOpenaiContentParts: [ - { type: "text", text: "see both" }, - { type: "image_url", image_url: { url: dataUrl(sx) } }, - { type: "image_url", image_url: { url: dataUrl(fl) } }, - { type: "image_url", image_url: { url: "https://example.com/remote.png" } }, - ], - }; - const single: BiliMessage = { - id: "r2", - role: "user", - contentType: "text", - text: "", - rawOpenaiContent: dataUrl(sx), - imageMediaType: sx.mediaType, - imageBase64: sx.b64, - }; - await applyImageCompressionPass(s, [multi, single], { config: enabledCfg(), billing: "pixels" }); - - const parts = multi.rawOpenaiContentParts as Array>; - const urlA = (parts[1].image_url as { url: string }).url; - const urlB = (parts[2].image_url as { url: string }).url; - const urlC = (parts[3].image_url as { url: string }).url; - assert.ok(urlA.startsWith("data:image/webp;base64,")); - assert.notEqual(urlA, dataUrl(sx)); - assert.equal(urlB, dataUrl(fl)); - assert.equal(urlC, "https://example.com/remote.png"); - - assert.equal(typeof single.rawOpenaiContent, "string"); - assert.ok((single.rawOpenaiContent as string).startsWith("data:image/webp;base64,")); - assert.equal(single.imageBase64, (single.rawOpenaiContent as string).split(",")[1]); - assert.equal(single.imageMediaType, "image/webp"); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 1); - assert.equal(imageShrinksForRef(s.state, "m00002").length, 1); -}); - -test("responses carrier: input_image parts rewritten, mirror synced", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const item = { - type: "message", - role: "user", - content: [ - { type: "input_text", text: "look" }, - { type: "input_image", image_url: `data:${fx.mediaType};base64,${fx.b64}` }, - ], - }; - const m: BiliMessage = { - id: "r1", - role: "user", - contentType: "text", - text: "", - rawResponsesItem: item, - imageMediaType: fx.mediaType, - imageBase64: fx.b64, - }; - await applyImageCompressionPass(s, [m], { config: enabledCfg(), billing: "pixels" }); - const content = (item.content as Array>); - const img = content[1]; - assert.ok(String(img.image_url).startsWith("data:image/webp;base64,")); - assert.equal(m.imageBase64, String(img.image_url).split(",")[1]); - assert.equal(m.imageMediaType, "image/webp"); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 1); -}); - -test("google carrier: inlineData parts rewritten", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const parts: Array> = [ - { text: "hi" }, - { inlineData: { mimeType: fx.mediaType, data: fx.b64 } }, - ]; - const m: BiliMessage = { id: "r1", role: "user", contentType: "text", text: "", rawGoogleParts: parts }; - await applyImageCompressionPass(s, [m], { config: enabledCfg(), billing: "pixels" }); - const inline = parts[1].inlineData as { mimeType: string; data: string }; - assert.equal(inline.mimeType, "image/webp"); - assert.notEqual(inline.data, fx.b64); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 1); -}); - -test("image_full restores original resolution for the rest of the session", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001", r2: "m00002" }); - const cfg = enabledCfg(); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx)], { config: cfg, billing: "pixels" }); - - const note = imageFullTrailingNote(s); - assert.ok(note !== undefined); - assert.ok(note.includes("Downscaled screenshots")); - assert.ok(note.includes("image_full")); - - const bad = executeImageFull({}, s, cfg).text; - assert.ok(bad.startsWith(IMAGE_FULL_FAILURE_MARKER)); - - const ghost = executeImageFull({ ref: "m99999" }, s, cfg).text; - assert.ok(ghost.startsWith(IMAGE_FULL_FAILURE_MARKER)); - - const ok = executeImageFull({ ref: "m00001" }, s, cfg).text; - assert.ok(!ok.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.equal(isImageFullRestored(s.state, "m00001"), true); - assert.equal(imageFullTrailingNote(s), undefined); - assert.equal(s.stats.imageFullCalls, 3); - assert.equal(s.stats.imageFullRestores, 1); - - // Restored ref: the next forward emits the ORIGINAL bytes untouched. - const fresh = anthropicMsg("r1", fx); - await applyImageCompressionPass(s, [fresh], { config: cfg, billing: "pixels" }); - assert.equal(antSrc(fresh).data, fx.b64); - assert.equal(antSrc(fresh).media_type, "image/png"); - - // Idempotent: a second restore of the same ref is a no-op success. - const again = executeImageFull({ ref: "m00001" }, s, cfg).text; - assert.ok(!again.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.equal(s.stats.imageFullRestores, 1); -}); - -test("isProxyToolFor gates image_full on arming", () => { - const cfg = enabledCfg(); - const armed = getSession(`img-gate-${Math.random().toString(36).slice(2)}`); - storeEffectiveImageCompression(armed, { enabled: true }); - assert.equal(isProxyToolFor(IMAGE_FULL_TOOL_NAME, armed, cfg), true); - const unarmed = getSession(`img-gate2-${Math.random().toString(36).slice(2)}`); - assert.equal(isProxyToolFor(IMAGE_FULL_TOOL_NAME, unarmed, cfg), false); - assert.equal(isProxyToolFor("acp_status", unarmed, cfg), true); -}); - -test("resetSessionCompression clears image state and caches", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const cfg = enabledCfg(); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx)], { config: cfg, billing: "pixels" }); - assert.ok((s.imageFingerprintsByRef?.get("m00001")?.length ?? 0) > 0); - // Restore invalidates the fingerprint entry by design (the shrunk bytes - // must be re-encodable from a fresh original if the session re-shrinks). - executeImageFull({ ref: "m00001" }, s, cfg); - assert.equal(s.imageFingerprintsByRef?.get("m00001"), undefined); - resetSessionCompression(s); - assert.equal(s.state.imageShrinks?.length ?? 0, 0); - assert.equal(s.state.imageFullRestored?.length ?? 0, 0); - assert.equal(s.imageEncodeCache?.size ?? 0, 0); - assert.equal(s.imageFingerprintsByRef?.size ?? 0, 0); -}); - -test("image state survives persist/reload round-trip", async () => { - const P = mkdtempSync(path.join(tmpdir(), "bili-img-persist-")); - try { - const store = new SessionStore({ dir: P, debounceMs: 0 }); - _setStoreForTest(store); - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx)], { config: enabledCfg(), billing: "pixels" }); - executeImageFull({ ref: "m00001" }, s, enabledCfg()); - markDirty(s); - store.flushSync(s); - _resetSessionsForTest(); - const reloaded = getSession(s.id); - assert.equal(imageShrinksForRef(reloaded.state, "m00001").length, 1); - assert.equal(isImageFullRestored(reloaded.state, "m00001"), true); - assert.equal(reloaded.stats.imageShrunkCount, 1); - assert.equal(reloaded.stats.imageFullCalls, 1); - assert.equal(reloaded.stats.imageFullRestores, 1); - assert.ok((reloaded.stats.imageBytesSaved ?? 0) > 0); - } finally { - _setStoreForTest(new SessionStore({ enabled: false })); - rmrf(P); - } -}); - -test("imageUsageSuffix reports lifetime savings alongside usage stats", async () => { - assert.equal(imageUsageSuffix(undefined), ""); - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - assert.equal(imageUsageSuffix(s), ""); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx)], { config: enabledCfg(), billing: "pixels" }); - assert.match(imageUsageSuffix(s), /img-saved=\d+tok/); -}); diff --git a/tests/issue3266-image-full-lane-gate.test.ts b/tests/issue3266-image-full-lane-gate.test.ts deleted file mode 100644 index 6fb9a08232..0000000000 --- a/tests/issue3266-image-full-lane-gate.test.ts +++ /dev/null @@ -1,215 +0,0 @@ -import test from "node:test"; -import assert from "node:assert/strict"; - -process.env.BILI_PERSIST = "0"; - -import sharp from "sharp"; -import { IMAGE_FULL_FAILURE_MARKER, defaultConfig, imageShrinksForRef } from "acp-kernel"; -import type { BiliMessage } from "acp-kernel/wire"; -import { applyCompressSettings } from "../src/compress-settings.ts"; -import { - applyImageCompressionPass, - executeImageFull, - imageFullRestoreArmed, - imageFullTrailingNote, - restorableRefs, - storeEffectiveImageCompression, - storeImageFullRestoreArmed, -} from "../src/image-compress.ts"; -import { getSession, type Session } from "../src/session.ts"; - -interface Fixture { b64: string; mediaType: string; width: number; height: number; bytes: number } - -async function makeFixture(width: number, height: number, patterned: boolean): Promise { - const raw = Buffer.alloc(width * height * 3); - if (patterned) { - for (let i = 0; i < raw.length; i += 3) { - raw[i] = i & 0xff; - raw[i + 1] = (i * 7) & 0xff; - raw[i + 2] = (i * 13) & 0xff; - } - } else { - raw.fill(0x88); - } - const buf = await sharp(raw, { raw: { width, height, channels: 3 } }).png().toBuffer(); - return { b64: buf.toString("base64"), mediaType: "image/png", width, height, bytes: buf.length }; -} - -// Same fixtures as tests/image-compress.test.ts: 2048×2944 patterned routes to -// downsample; the encode cache keys on content, so many messages sharing one -// fixture cost a single sharp encode. -let shotCache: Fixture | undefined; -async function shot(): Promise { - return (shotCache ??= await makeFixture(2048, 2944, true)); -} - -function armedSession(byRaw: Record): Session { - const s = getSession(`img3266-${Math.random().toString(36).slice(2)}`); - storeEffectiveImageCompression(s, { enabled: true }); - for (const [raw, ref] of Object.entries(byRaw)) { - s.state.messageRefs.byRaw[raw] = ref; - s.state.messageRefs.byRef[ref] = raw; - } - return s; -} - -function enabledCfg(extra: Record = {}): ReturnType { - return applyCompressSettings(defaultConfig(200_000), 200_000, { imageCompression: { enabled: true, ...extra } }); -} - -function anthropicMsg(id: string, fx: Fixture): BiliMessage { - return { - id, - role: "user", - contentType: "text", - text: "", - rawAnthropicBlock: { type: "image", source: { type: "base64", media_type: fx.mediaType, data: fx.b64 } }, - }; -} - -function antData(m: BiliMessage): string { - return (m.rawAnthropicBlock as unknown as { source: { data: string } }).source.data; -} - -const logsOf = (): { logs: string[]; log: (level: "info" | "warn" | "error", msg: string) => void } => { - const logs: string[] = []; - return { logs, log: (level, msg) => logs.push(`${level}|${msg}`) }; -}; - -test("#3266 note lists the exact restorable refs; restored and pruned refs are excluded", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001", r2: "m00002", r3: "m00003" }); - const cfg = enabledCfg(); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx), anthropicMsg("r2", fx), anthropicMsg("r3", fx)], { config: cfg, billing: "pixels" }); - assert.deepEqual(restorableRefs(s), ["m00001", "m00002", "m00003"]); - - // m00002 gets restored → out of the list; m00003's ref is pruned from the - // live map (compaction archive) → listing it would only feed rejections. - executeImageFull({ ref: "m00002" }, s, cfg); - delete s.state.messageRefs.byRef["m00003"]; - assert.deepEqual(restorableRefs(s), ["m00001"]); - - const note = imageFullTrailingNote(s); - assert.ok(note !== undefined); - assert.ok(note.includes("Restorable refs")); - assert.ok(note.includes("m00001")); - assert.ok(!note.includes("m00002")); - assert.ok(!note.includes("m00003")); -}); - -test("#3266 note caps the ref list at 20 with a remainder marker", async () => { - const fx = await shot(); - const byRaw: Record = {}; - for (let i = 1; i <= 25; i++) byRaw[`r${i}`] = `m${String(i).padStart(5, "0")}`; - const s = armedSession(byRaw); - const cfg = enabledCfg(); - const msgs = Object.entries(byRaw).map(([raw]) => anthropicMsg(raw, fx)); - await applyImageCompressionPass(s, msgs, { config: cfg, billing: "pixels" }); - assert.equal(imageShrinksForRef(s.state, "m00025").length, 1); - - const note = imageFullTrailingNote(s); - assert.ok(note !== undefined); - assert.ok(note.includes("m00020")); - assert.ok(!note.includes("m00021")); - assert.ok(note.includes("+5 more")); -}); - -test("#3266 disarmed lane serves the plain not-restorable note instead of a tool promise", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const cfg = enabledCfg(); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx)], { config: cfg, billing: "pixels" }); - - // Default when never stamped: ARMED (pre-#3266 behavior for unaudited paths). - assert.equal(imageFullRestoreArmed(s), true); - assert.ok(imageFullTrailingNote(s)?.includes("Restorable refs")); - - storeImageFullRestoreArmed(s, false); - const note = imageFullTrailingNote(s); - assert.ok(note !== undefined); - assert.ok(note.includes("CANNOT be restored")); - assert.ok(!note.includes("Restorable refs")); - assert.ok(note.includes("do not call image_full")); -}); - -test("#3266 two consecutive failures suppress the armed note; a success re-arms it", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001", r2: "m00002" }); - const cfg = enabledCfg(); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx), anthropicMsg("r2", fx)], { config: cfg, billing: "pixels" }); - assert.ok(imageFullTrailingNote(s) !== undefined); - - executeImageFull({ ref: "m99999" }, s, cfg); - assert.equal(s.stats.imageFullFailStreak, 1); - assert.ok(imageFullTrailingNote(s) !== undefined); - - executeImageFull({}, s, cfg); - assert.equal(s.stats.imageFullFailStreak, 2); - assert.equal(imageFullTrailingNote(s), undefined); - - // A real restore resets the streak; m00002 stays active so the note returns. - const ok = executeImageFull({ ref: "m00001" }, s, cfg); - assert.ok(!ok.text.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.equal(s.stats.imageFullFailStreak, 0); - const note = imageFullTrailingNote(s); - assert.ok(note !== undefined); - assert.ok(note.includes("m00002")); -}); - -test("#3266 failed receipts carry the restorable ref list (or an explicit none)", async () => { - const fx = await shot(); - const withRef = armedSession({ r1: "m00001" }); - const cfg = enabledCfg(); - await applyImageCompressionPass(withRef, [anthropicMsg("r1", fx)], { config: cfg, billing: "pixels" }); - - const rejected = executeImageFull({ ref: "m99999" }, withRef, cfg); - assert.ok(rejected.text.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.ok(rejected.text.includes("Restorable refs in this session")); - assert.ok(rejected.text.includes("m00001")); - - const parseFail = executeImageFull({}, withRef, cfg); - assert.ok(parseFail.text.includes("invalid input")); - assert.ok(parseFail.text.includes("m00001")); - - const empty = armedSession({}); - const none = executeImageFull({ ref: "m00001" }, empty, cfg); - assert.ok(none.text.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.ok(none.text.includes("No downscaled image in this session is currently restorable")); - - const success = executeImageFull({ ref: "m00001" }, withRef, cfg); - assert.ok(!success.text.startsWith(IMAGE_FULL_FAILURE_MARKER)); - assert.ok(!success.text.includes("Restorable refs")); -}); - -test("#3266 after a state reload the original bytes are recognized by size and re-shrunk without duplicate records or logs", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const cfg = enabledCfg(); - const first = anthropicMsg("r1", fx); - const { logs, log } = logsOf(); - await applyImageCompressionPass(s, [first], { config: cfg, billing: "pixels", log }); - const shrunkB64 = antData(first); - assert.notEqual(shrunkB64, fx.b64); - assert.equal(logs.filter((l) => l.startsWith("info")).length, 1); - - // Simulate a process restart / LRU evict+reload: persisted records survive, - // the host-side fingerprint map and encode cache are gone. - s.imageFingerprintsByRef = undefined; - s.imageEncodeCache = undefined; - - const second = anthropicMsg("r1", fx); - logs.length = 0; - await applyImageCompressionPass(s, [second], { config: cfg, billing: "pixels", log }); - assert.equal(antData(second), shrunkB64); - assert.equal(imageShrinksForRef(s.state, "m00001").length, 1); - assert.equal(s.stats.imageShrunkCount, 1); - assert.equal(logs.filter((l) => l.startsWith("info")).length, 0); -}); - -test("#3266 shrink log carries the session id", async () => { - const fx = await shot(); - const s = armedSession({ r1: "m00001" }); - const { logs, log } = logsOf(); - await applyImageCompressionPass(s, [anthropicMsg("r1", fx)], { config: enabledCfg(), billing: "pixels", log }); - assert.ok(logs.some((l) => l.includes(`[acp-image] [${s.id}] m00001:`))); -}); diff --git a/tests/issue3272-ccr-codex-lane-gate.test.ts b/tests/issue3272-ccr-codex-lane-gate.test.ts index e6ec00673f..6e540ec859 100644 --- a/tests/issue3272-ccr-codex-lane-gate.test.ts +++ b/tests/issue3272-ccr-codex-lane-gate.test.ts @@ -17,7 +17,7 @@ import { _setForTest as setRegistryForTest } from "../src/registry.ts"; // records a synthetic "unsupported call" entry in its own resent history — so an // armed CCR on that host would declare acp_retrieve (unroutable by the host) AND // placeholderize oversized tool results the model can never retrieve back (silent -// loss). Same mechanism as image_full (#3266/#3270). These tests pin the gate at +// loss). Same mechanism as the removed image_full restore channel (#3266/#3270). These tests pin the gate at // the policy-stamping site on the native-tool responses wire: a codex client gets // CCR disarmed (no acp_retrieve declaration, oversized tool result stays verbatim); // a non-codex client on the same wire keeps CCR armed (regression guard against diff --git a/tests/persist-stats-roundtrip.test.ts b/tests/persist-stats-roundtrip.test.ts index ed6eb8a345..b722c226f3 100644 --- a/tests/persist-stats-roundtrip.test.ts +++ b/tests/persist-stats-roundtrip.test.ts @@ -50,36 +50,3 @@ test("stats retrieval-quality counters survive a reload round-trip", async () => rmrf(dir); } }); - -// #3266: the image_full fail-streak guardrail suppresses the restore note after -// repeated failures. The save path spreads session.stats wholesale, so if the -// loader's field-by-field whitelist forgets the field, every restart silently -// resets the streak and re-arms the note right back into the failure loop. -test("stats imageFullFailStreak survives a reload round-trip", async () => { - const dir = mkdtempSync(join(tmpdir(), "bili-streak-")); - try { - const store = new SessionStore({ dir, debounceMs: 5, enabled: true }); - const s = makeSession("streak-1"); - s.stats.imageFullFailStreak = 2; - await store.writeNow(s); - await store.flushAll([]); - - const sNone = makeSession("streak-none"); - await store.writeNow(sNone); - await store.flushAll([]); - - const reloaded = new SessionStore({ dir, debounceMs: 5, enabled: true }); - const back = reloaded.loadSync("streak-1"); - assert.ok(back, "session reloaded"); - assert.equal(back.stats.imageFullFailStreak, 2, "imageFullFailStreak round-trips"); - // Absence must survive as absence: materializing 0 for sessions that never - // used image_full would change their persisted bytes (storage corpus / - // render-golden digests pin those bytes). - const backNone = reloaded.loadSync("streak-none"); - assert.ok(backNone, "second session reloaded"); - assert.equal(backNone.stats.imageFullFailStreak, undefined, "absent streak stays absent"); - await reloaded.flushAll([]); - } finally { - rmrf(dir); - } -}); diff --git a/tests/pi-subagent-channel.test.ts b/tests/pi-subagent-channel.test.ts index 00f17bb453..7b6d218445 100644 --- a/tests/pi-subagent-channel.test.ts +++ b/tests/pi-subagent-channel.test.ts @@ -123,7 +123,7 @@ test("detectPiSubagentChildSignal: unparseable or non-object bodies fail closed // — exposure walker — test("exposesBiliInjectableTool: every injectable name in every wire shape", () => { - const names = ["compress", "decompress", "search_context", "acp_status", "acp_rule", "acp_retrieve", "absorb", "image_full"]; + const names = ["compress", "decompress", "search_context", "acp_status", "acp_rule", "acp_retrieve", "absorb"]; for (const n of names) { assert.equal(exposesBiliInjectableTool([{ name: n }]), true, `top-level ${n}`); assert.equal(exposesBiliInjectableTool([{ type: "function", function: { name: n } }]), true, `openai ${n}`); diff --git a/tests/plugin-fork.test.ts b/tests/plugin-fork.test.ts index 5c9328cea5..ab06cfc241 100644 --- a/tests/plugin-fork.test.ts +++ b/tests/plugin-fork.test.ts @@ -675,7 +675,7 @@ test("HTTP fork revision and originals survive a new proxy process", async () => parent.contentStore = storeOriginal(createContentStore(), { ref: "m00001", rawId: parent.pluginSnapshot![0].id, text: "CCR original retained independently after restart", kind: "original", tokens: 10, head: "CCR original" }); parent.contentStoreDirty = true; assert(h.store.flushSync(parent)); - assert.deepEqual(JSON.parse(JSON.stringify(h.store.loadSync("parent")!.state)), JSON.parse(JSON.stringify({ ...parent.state, imageFullRestored: parent.state.imageFullRestored ?? [], imageShrinks: parent.state.imageShrinks ?? [] }))); + assert.deepEqual(JSON.parse(JSON.stringify(h.store.loadSync("parent")!.state)), JSON.parse(JSON.stringify(parent.state))); const snapshot = (await h.request("/__bili/plugin/snapshot?conversationId=parent")).body; const req = forkRequest(snapshot); const fork = await h.request("/__bili/plugin/fork", req); diff --git a/tests/storage-corpus.test.ts b/tests/storage-corpus.test.ts index ec2f0cc31d..7ea0be70d5 100644 --- a/tests/storage-corpus.test.ts +++ b/tests/storage-corpus.test.ts @@ -154,12 +154,31 @@ test("storage corpus: fork contract — receipt keeps store, retained-only DROPS assert.equal(retained.contentStore, undefined, "retained-only: forkContentStore is DROPPED by buildRecord — this verbatim asymmetry is why #2675 ② exists"); }); -test("storage corpus: image case carries base64 media + image stats", () => { +test("storage corpus: image case carries base64 media; legacy image-compression keys land per the #3266 back-compat contract", () => { + // Back-compat pin for the #3266 removal: the generator re-injects the + // pre-removal image-compression keys into the on-disk record after the + // normal write (scripts/update-storage-corpus.ts), so the fixture carries + // exactly what an older version persisted. Contract on load: whitelisted + // readers DROP the stats.* and state.* keys; metadata is an opaque host + // bag and passes THROUGH — its imageShrinks entry survives as inert data + // nothing reads anymore. Media bytes survive untouched either way. const s = loadCase("image"); const img = s.lastMessages?.find((m) => (m as { contentType?: string }).contentType === "image"); assert.ok(img, "image message must survive in the persisted tail"); - assert.equal(s.stats.imageShrunkCount, 1); - assert.ok(Array.isArray(s.metadata.imageShrinks), "imageShrinks metadata must survive"); + const st = s.stats as unknown as Record; + assert.equal(st.imageShrunkCount, undefined, "legacy imageShrunkCount must NOT materialize"); + assert.equal(st.imageBytesSaved, undefined, "legacy imageBytesSaved must NOT materialize"); + assert.equal(st.imageTokensSaved, undefined, "legacy imageTokensSaved must NOT materialize"); + assert.equal(st.imageFullCalls, undefined, "legacy imageFullCalls must NOT materialize"); + assert.equal(st.imageFullRestores, undefined, "legacy imageFullRestores must NOT materialize"); + const cs = s.state as unknown as Record; + assert.equal(cs.imageShrinks, undefined, "legacy state.imageShrinks must NOT materialize"); + assert.equal(cs.imageFullRestored, undefined, "legacy state.imageFullRestored must NOT materialize"); + assert.deepEqual( + (s.metadata as Record).imageShrinks, + [{ ref: "m00021", from: 8192, to: 4096 }], + "metadata is an opaque host bag — legacy imageShrinks passes through inert", + ); }); test("storage corpus: ccr sibling file holds the two #1097 originals", () => { diff --git a/tests/wire-contract-inventory.ts b/tests/wire-contract-inventory.ts index f73e310792..be25476a55 100644 --- a/tests/wire-contract-inventory.ts +++ b/tests/wire-contract-inventory.ts @@ -24,7 +24,6 @@ import { BILI_SEARCH_CONTEXT_TOOL_GOOGLE, BILI_SEARCH_CONTEXT_TOOL_OPENAI, BILI_SEARCH_CONTEXT_TOOL_RESPONSES, - IMAGE_FULL_TOOL_GOOGLE, RULE_TOOL, RULE_TOOL_GOOGLE, RULE_TOOL_OPENAI, @@ -76,9 +75,6 @@ function buildKernelGolden(): Record { ABSORB_TOOL: K.ABSORB_TOOL, ABSORB_TOOL_OPENAI: K.ABSORB_TOOL_OPENAI, ABSORB_TOOL_GOOGLE: K.ABSORB_TOOL_GOOGLE, - IMAGE_FULL_TOOL: K.IMAGE_FULL_TOOL, - IMAGE_FULL_TOOL_OPENAI: K.IMAGE_FULL_TOOL_OPENAI, - IMAGE_FULL_TOOL_RESPONSES: K.IMAGE_FULL_TOOL_RESPONSES, RETRIEVE_TOOL: K.RETRIEVE_TOOL, RETRIEVE_TOOL_OPENAI: K.RETRIEVE_TOOL_OPENAI, RETRIEVE_TOOL_RESPONSES: K.RETRIEVE_TOOL_RESPONSES, @@ -98,7 +94,6 @@ function buildKernelGolden(): Record { ABSORB_TOOL_NAME: K.ABSORB_TOOL_NAME, RETRIEVE_TOOL_NAME: K.RETRIEVE_TOOL_NAME, RULE_TOOL_NAME: K.RULE_TOOL_NAME, - IMAGE_FULL_TOOL_NAME: K.IMAGE_FULL_TOOL_NAME, }, markers: { ACP_TEXT_OPEN: K.ACP_TEXT_OPEN, @@ -136,7 +131,6 @@ function buildBiliGolden(): Record { ruleResponses: RULE_TOOL_RESPONSES, ruleGoogle: RULE_TOOL_GOOGLE, retrieveAcpRetrieve: retrieveToolsFor("acp_retrieve"), - imageFullGoogle: IMAGE_FULL_TOOL_GOOGLE, }, }; } diff --git a/tests/wire-contract.test.ts b/tests/wire-contract.test.ts index 87ead5787b..7c2b18bb37 100644 --- a/tests/wire-contract.test.ts +++ b/tests/wire-contract.test.ts @@ -4,7 +4,7 @@ // into one module with four layers: // A. kernel exports — every tool constant the pinned acp-kernel ships, per wire // B. bili surfaces — everything bili itself builds/serves (BILI_* tools, synthesized -// variants, retrieveToolsFor, IMAGE_FULL_TOOL_GOOGLE) +// variants, retrieveToolsFor) // C. plugin manifest — what handlePluginManifest advertises (default + opt-in configs) // D. live forward matrix — scripted client request -> proxy -> validation-parity fake // upstream, one lane per protocol (item 1 + item 4 phase (a)): the forwarded body @@ -50,7 +50,6 @@ import { RULE_TOOL_RESPONSES, RULE_TOOL_GOOGLE, retrieveToolsFor, - IMAGE_FULL_TOOL_GOOGLE, } from "../src/compress-tool.ts"; import { WIRE_RULES, WIRE_HEADER_RULES, VALIDATORS, startFakeUpstream, validateResponsesWsCreate, validateCodexResponsesWsCreate, validateGoSessionHeaders, type Wire } from "./wire-contract-fakes.ts"; @@ -239,7 +238,6 @@ const KERNEL_INDIVIDUALS: Array<[string, Wire]> = [ ["ACP_CACHE_TOOL", "anthropic"], ["ACP_CACHE_TOOL_OPENAI", "openai-chat"], ["ACP_CACHE_TOOL_RESPONSES", "responses"], // opt-in tools the kernel ships individually (host-registered) ["ABSORB_TOOL", "anthropic"], ["ABSORB_TOOL_OPENAI", "openai-chat"], ["ABSORB_TOOL_GOOGLE", "google"], - ["IMAGE_FULL_TOOL", "anthropic"], ["IMAGE_FULL_TOOL_OPENAI", "openai-chat"], ["IMAGE_FULL_TOOL_RESPONSES", "responses"], ["RETRIEVE_TOOL", "anthropic"], ["RETRIEVE_TOOL_OPENAI", "openai-chat"], ["RETRIEVE_TOOL_RESPONSES", "responses"], ]; @@ -277,14 +275,13 @@ const BILI_INDIVIDUALS: Array<[string, Wire]> = [ ["BILI_DECOMPRESS_TOOL", "anthropic"], ["BILI_DECOMPRESS_TOOL_OPENAI", "openai-chat"], ["BILI_DECOMPRESS_TOOL_RESPONSES", "responses"], ["BILI_DECOMPRESS_TOOL_GOOGLE", "google"], ["ABSORB_TOOL_RESPONSES", "responses"], ["RULE_TOOL", "anthropic"], ["RULE_TOOL_OPENAI", "openai-chat"], ["RULE_TOOL_RESPONSES", "responses"], ["RULE_TOOL_GOOGLE", "google"], - ["IMAGE_FULL_TOOL_GOOGLE", "google"], ]; const BILI_CONSTANTS: Record = { BILI_ACP_TOOLS_ANTHROPIC, BILI_ACP_TOOLS_OPENAI, BILI_ACP_TOOLS_RESPONSES, BILI_ACP_TOOLS_GOOGLE, BILI_ACP_READONLY_TOOLS_RESPONSES, BILI_SEARCH_CONTEXT_TOOL, BILI_SEARCH_CONTEXT_TOOL_OPENAI, BILI_SEARCH_CONTEXT_TOOL_RESPONSES, BILI_SEARCH_CONTEXT_TOOL_GOOGLE, BILI_DECOMPRESS_TOOL, BILI_DECOMPRESS_TOOL_OPENAI, BILI_DECOMPRESS_TOOL_RESPONSES, BILI_DECOMPRESS_TOOL_GOOGLE, - ABSORB_TOOL_RESPONSES, RULE_TOOL, RULE_TOOL_OPENAI, RULE_TOOL_RESPONSES, RULE_TOOL_GOOGLE, IMAGE_FULL_TOOL_GOOGLE, + ABSORB_TOOL_RESPONSES, RULE_TOOL, RULE_TOOL_OPENAI, RULE_TOOL_RESPONSES, RULE_TOOL_GOOGLE, RETRIEVE_TOOLS: retrieveToolsFor("acp_retrieve"), }; diff --git a/website/config-reference/compress.yaml b/website/config-reference/compress.yaml index f7b61ee720..c21afd2025 100644 --- a/website/config-reference/compress.yaml +++ b/website/config-reference/compress.yaml @@ -295,16 +295,6 @@ entries: desc_zh: "开启后 search_context 候选按当前计划状态重排;关闭时结果逐字节不变。" site_en: "search.planAware — off by default: when on, search_context candidates are re-ranked against current plan state (latest-wins todos + last user turn); off keeps byte-identical lexical results." site_zh: "search.planAware —— 默认关:开启后 search_context 候选按当前计划状态重排(todo 最新优先 + 上一轮用户消息);关闭时结果逐字节不变。" - - key: compress.imageCompression - type: object - default: "opt-in (disabled)" - group: compress - id: co.img - render: obj-item - desc_en: "Opt-in lossy downscale via optional sharp before sending; image_full restores originals; proxy mode only." - desc_zh: "可选有损缩放(依赖可选 sharp)后再发送;image_full 取回原图;仅限代理模式。" - site_en: "imageCompression — opt-in lossy downscale via optional sharp before sending (enabled, minTokens 512, maxDimension 1280, quality 80, format \"webp\"); image_full restores originals; proxy mode only." - site_zh: "imageCompression —— 可选有损缩放(依赖可选 sharp)后再发送(enabled, minTokens 512, maxDimension 1280, quality 80, format \"webp\");image_full 取回原图;仅限代理模式。" - key: compress.prompts type: "Partial" default: "unset (kernel doctrine)" @@ -415,36 +405,6 @@ entries: group: compress desc_en: "Maximum head-excerpt length left inline at the storage pointer." desc_zh: "存储指针处内联首段摘录的最大长度。" - - key: compress.imageCompression.enabled - type: boolean - default: "false" - group: compress - desc_en: "Enable lossy image downscaling (requires the optional sharp dependency)." - desc_zh: "启用有损图片缩放(需要可选依赖 sharp)。" - - key: compress.imageCompression.minTokens - type: number - default: "512" - group: compress - desc_en: "Only downscale images whose counted tokens exceed this." - desc_zh: "只对计得 token 超过该值的图片做缩放。" - - key: compress.imageCompression.maxDimension - type: number - default: "1280" - group: compress - desc_en: "Largest output dimension after downscaling." - desc_zh: "缩放后的最大输出边长。" - - key: compress.imageCompression.quality - type: number - default: "80" - group: compress - desc_en: "Encoder quality (1–100)." - desc_zh: "编码质量(1–100)。" - - key: compress.imageCompression.format - type: string - default: "\"webp\"" - group: compress - desc_en: "Output image format." - desc_zh: "输出图片格式。" - key: compress.prompts.compressPhilosophy type: string default: "unset (kernel text)" diff --git a/website/docs/index.html b/website/docs/index.html index e06ea3e6cc..f75c6eb81d 100644 --- a/website/docs/index.html +++ b/website/docs/index.html @@ -212,7 +212,6 @@

compress — every knob

  • ccr — content cache & retrieve: large outputs are stored losslessly beside the session and replaced by a head excerpt plus pointer; the model fetches originals back via acp_retrieve. No cap or eviction; on by default in proxy mode since v2 (enabled, minToolTokens (~4000), excludeTools, toolName "acp_retrieve", maxHeadChars).
  • search — search-behavior settings for search_context; currently holds planAware.
  • search.planAware — off by default: when on, search_context candidates are re-ranked against current plan state (latest-wins todos + last user turn); off keeps byte-identical lexical results.
  • -
  • imageCompression — opt-in lossy downscale via optional sharp before sending (enabled, minTokens 512, maxDimension 1280, quality 80, format "webp"); image_full restores originals; proxy mode only.
  • prompts — override the kernel doctrine texts (compressPhilosophy, howToCompressRules, tier2DistillRules, tier3CondenseRules); load-bearing for quality — gated behind acknowledgePromptsRisk.
  • reasoningGuard — auto-repair of reasoning-lattice truncation on gpt-5.x/6.x (≤3 continue-nudge rounds, marker "Continue thinking...") (enabled, maxContinue, maxTierN, markerText, base, offset, debugLog).
  • outputSteering — { enabled? false, verbosityLevel? 2 (0–4), effortRouting? }: appends a conciseness directive to the system-prompt tail; clamps mechanical continuation requests.
  • diff --git a/website/main.js b/website/main.js index 0d35376cdf..5816d13a08 100644 --- a/website/main.js +++ b/website/main.js @@ -90,7 +90,6 @@ "co.ccr": "ccr — content cache & retrieve: large outputs are stored losslessly beside the session and replaced by a head excerpt plus pointer; the model fetches originals back via acp_retrieve. No cap or eviction; on by default in proxy mode since v2 (enabled, minToolTokens (~4000), excludeTools, toolName \"acp_retrieve\", maxHeadChars).", "co.searchRoot": "search — search-behavior settings for search_context; currently holds planAware.", "co.search": "search.planAware — off by default: when on, search_context candidates are re-ranked against current plan state (latest-wins todos + last user turn); off keeps byte-identical lexical results.", - "co.img": "imageCompression — opt-in lossy downscale via optional sharp before sending (enabled, minTokens 512, maxDimension 1280, quality 80, format \"webp\"); image_full restores originals; proxy mode only.", "co.prompts": "prompts — override the kernel doctrine texts (compressPhilosophy, howToCompressRules, tier2DistillRules, tier3CondenseRules); load-bearing for quality — gated behind acknowledgePromptsRisk.", "co.rg": "reasoningGuard — auto-repair of reasoning-lattice truncation on gpt-5.x/6.x (≤3 continue-nudge rounds, marker \"Continue thinking...\") (enabled, maxContinue, maxTierN, markerText, base, offset, debugLog).", "co.os": "outputSteering — { enabled? false, verbosityLevel? 2 (0–4), effortRouting? }: appends a conciseness directive to the system-prompt tail; clamps mechanical continuation requests.", @@ -329,7 +328,6 @@ "co.ccr": "ccr —— 内容缓存与回取:大输出无损存到会话旁、替换为首段摘录+指针,模型用 acp_retrieve 取回原文;无上限、永不清除;自 v2 起代理模式默认开(enabled, minToolTokens(~4000), excludeTools, toolName \"acp_retrieve\", maxHeadChars)。", "co.searchRoot": "search —— search_context 的检索行为设置;当前含 planAware。", "co.search": "search.planAware —— 默认关:开启后 search_context 候选按当前计划状态重排(todo 最新优先 + 上一轮用户消息);关闭时结果逐字节不变。", - "co.img": "imageCompression —— 可选有损缩放(依赖可选 sharp)后再发送(enabled, minTokens 512, maxDimension 1280, quality 80, format \"webp\");image_full 取回原图;仅限代理模式。", "co.prompts": "prompts —— 覆盖内核教条文本(compressPhilosophy, howToCompressRules, tier2DistillRules, tier3CondenseRules);对压缩质量承重要——受 acknowledgePromptsRisk 门控。", "co.rg": "reasoningGuard —— gpt-5.x/6.x 推理格截断自动修复(≤3 轮继续提示,标记 \"Continue thinking...\")(enabled, maxContinue, maxTierN, markerText, base, offset, debugLog)。", "co.os": "outputSteering —— { enabled? false, verbosityLevel? 2 (0–4), effortRouting? }:向系统提示词尾部附加简洁度指令;只收紧机械延续请求。",